Well. In my mind the cut off is Persona 3. Past there, it all becomes its own thing. Igor becomes a higher entity with more interesting lackies, you have social links and Personas born from childrens hearts. Oh and animals. And Machines.

But I assumed unless they directly stated, there is no corrolation between a past game. And or Universe.
And I wouldn't count references, they're merely easter eggs.