Well, I definitely see a conflict with the elder Dursleys, that's to be sure, but maybe Hermione's parents also wanted her to marry someone else, perhaps an old family friend's son?