It seems I can sum up the root of my problems with girls.
An old girlfriend I dumped because she was too young to understand that I needed loving attention from her is the one of which I am talking.
I told her I was sorry, and I gave her a reason why I was saying it, I told her that I enjoyed her company though it was entirely up to her; if she didn't enjoy mine then there was no point in keeping a relationship.
I like her, but I would much rather her be happy than be with me and unhappy. It just makes me misreable that I make others misreable.