The girl and the guy are both afraid of disappointing their master. As for Grora and Wodahs... I'm not sure. It's never explicitly stated what they are afraid of, but I guess you could say that they're afraid of war.
Don't worry, @Darkmoon Angel! Once I'm done being sad about my life, I'll make a post!