The Ent hold themselves apart mostly out of ignorance, rather than a sense of superiority. They're literally a race of tree-shepherds, not many of them are terribly bright. There's also the fact that they're pretty close to dying out, which makes them a rarity in fae courts.