The thing is, those are perfectly fine maps. They aren't said issue.

The issue comes when you actively have to fight with the Arena, instead of just the opponent. Like the Tilting Building, where you are less fighting the opponent and more dealing with the arena.

The boring ones are perfect for ranked fights, as they focus on skill. The things in them are fine, like kicking dirt or tossing sand. Not trees that randomly swing out and try hit you for coming to close, or a building that forces you run down its side.