Morality isn't objective. Negative behaviour that is initially negative only to the self can be contagious, and influence others to follow that same behaviour, ultimately to the detriment of society as a whole.