Because of the fact that he brought her back to Veiron and acted like it wasn't a big deal. He doesn't know her story, so I assumed she'd be mad and think of him as insensitive.