@PaulHaynekedited for grammar:
All mages have powers. He still holds no chance against Lancer, or Caster. There are only a few people I know who can hold their own. Emiya (Unlimited Blade works), Souichirou Kuzuki (trained assassin who more or less had to fight a nerfed down Arthur WITH Caster's help), Rin (she's in the top thirty magi in history), Kirei (I don't see him winning a real fight), and Kiritsugu (his time powers will give him breathing room but like Kirei It will be a circumstantial win). Being able to distract a servant is one thing because it depends on the servant in question. A smart master wouldn't get near an enemy servant if given the choice. they'd speed blitz and murder you.
Short story made shorter: It's possible to barely defend oneself against a servant if you have some sort of combat talent, or deus ex machina like Shiro but it's not exactly medium tier guys doing anything meaningful. Let's take my guy: Leon, my master, is a skilled duelist as he fights in sanctioned mage duels back in america. He has talent when it comes to using his magic in combat situations. Wind, and Water affinity likewise make him pretty flexible. However he won't be able to hold back a servant, or track them easy. In another version of this rp Avenger literally speed blitzed him, grabbed his hand, and would have killed him if he wasn't interested in seeing him suffer more. Leon was for all intents, and purposes having his hand crushed by a being he had little chance against.