As Azelius is about to walk away, he stops again as soon as he heard the second question and turns back to the armored woman. He didn't expect her to actually continue the conversation. She seemed to be a spectator just like him, so Azelius just assumed she'd understand his answer and he could be on his way to wherever. There is a small part of him that's curious about what she's doing here in particular, but he couldn't be bothered to actually pursue it. Whatever she wants to do is her business, it's not really any of his concern as long as she doesn't get in his way. However, he might as well oblige her with an answer.

"You're partly right, I guess. I mainly wanted to see a fight and instead, I just see someone bailing out at the slightest hint of an actual confrontation." 

Assuming the conversation is over, Azelius turns around and walks away from her. Perhaps it's time to go outside Farecia's borders again for some actual excitement.