Lilith's crying did it.

He wouldn't take just Lilith so he decided to take everyone or no one at all.