I always thought the multiverse the arena existed in was like a conglomerate of all the places our characters came from, and those that can travel between dimensions are the special ones. 

If it's not, boy oh boy I've been doing shit wrong.