Except Shieldbreaker counters you and some of the other swords are capable of countering Mindslayers effects somewhat.

Oh and if anyone leaves your field of influence, they're not going to be happy you mind controlled them. Lastly, it's not stated as to whether Doomslayer can reverse the effects on the wielder, but it probably can.