The guards are not necessarily all on the ground, some may be standing on a citadel wall with bows and try to shoot..