Look at what a single year did to Carol in the T.V. show, now imagine that times three. I can't imagine there would be weak people left, and with the number of Walkers dwindling, survival would be more focused on gathering food and fresh water than avoiding bandits or walkers.