[@Spriggs27]

Well if those guards won't attack him on sight, then he won't fight them and will politely request if he could discuss with the head of the manor... though I doubt any sane guard would accept to allow him through.