Now that brothers exist, I downgraded my manor in Jorvik from Great to Stone and now I am turning another fief point into family points. Haven't spent it yet though.