I don't mind your guys being resistant to swords, just make them able to distort them (I suppose that's a way to harm them in some sort of way). In addition, I think that your guys could be able to form some sort of thing to help them build stuff (like a weak hand for instance).