I know that a certain Daedra of knowledge would be against the invasion, because he wouldn't be able to have his little slaves then.