Was having Invictus and Fate ever really that necessary?

They were so detached and mysterious that you could have removed them from the plot and it wouldn't have mattered much, maybe aside from Invictus making Ialu.