I'm sorta on the same page as... Well, Griever. Who thought that'd ever happen? 

Open and honest communication is a large part of the foundation for a healthy relationship, and I apologise if I'm wrong but I get the impression there's been more self-justification than communication. Look, if you'd just have said "I don't feel good about having a relationship where I always feel guilty, a feeling that persists regardless of what he tells me." I'd understand completely and I'd probably be saying something about Ben & Jerry's or whatever (god that is delicious.) But if I'm honest, I don't think you should disempower and reason for a person, especially not for one you love. Instead have an open and honest conversation with them. At 24 we can hold a guy responsible for his decisions, especially if they're well-informed. You could've given him your honest feelings and expectations for him to base his decision on. Be open, be honest, and respect people to make their own decisions. That's really the best you can do.

It might not be of much use now and it's not to hit you on the way out or anything, but it's something I hope you can give some thought for your next relationship.