[quote=@AwesomeZero5]
<Snipped quote by Double>

Aaawr, don't want to pick Siloh up? X3
[/quote]

It's just that he's coming from a totally different direction. Ninja Village is located in between Anistar City and Couriway Town. That means he'll be hoofing it through the mountainous routes that wrap around the western side of Kalos in order to reach Santalune City so he can go south back to Vanville.

He can be there to pick Siloh up provided he arrives early enough. It just depends on when he received his letter and departed compared to the others, I guess.