Kenjutsu and Taijutsu are not one and the same. You're assuming that all UFC fighters are epic with a sword, or every Olympic jouster is epic in a hand-to-hand fight.

Elemental limitations - that is clearly a weakness if you can counter the one element in exactly the same fashion each time.