Yes, you can. However, you might have trouble joining the main group as they're about to head into the dungeon.