[@MrDidact] The two have big ideological and personal differences, particularly over how to deal with the mountain clans and the rumors about Mychel and Lucas Royce. And as was said in the biography, Ser Harry (who has a near monopoly over Sweetrobin's ear) undermined Mychel's efforts to advise his father. Also, Ser Harry is still hoping to inherit the Vale someday.