Having all the characters reside in the same place would be convinient. I can't think of any specific canons where not being in the place where they live in-canon would mess things up. This way, all the different characters have easy access to each other.