I mean, that's fair, it's just that the Iron Rose knights and their status are well-known. It's a hard mistake to make.

That being said, a possible explanation is "surrounded by all those noble knights might keep in on the right track" sort of thing or something?