What Might I Have Done Wrong Here?!

[TruAngel]

I've dated a 43 year old guy (I am 40) for the past 6 months. One night, we came very close to being intimate, but I really thought it was too soon. I asked him what he thought; he agreed that it might be too soon. I really like him. The next day we discussed what happened (or rather didn't happen) the night before and decided that we really wanted to be intimate with each other and that we should just do it. We made plans for him to stay the night with me. He drove over to my side of town and we cuddled, talked, and laughed. Then all of a sudden he announces that he cannot stay the night, so we DID NOT sleep together. I was completely caught off guard. I asked him why he was leaving. He said that he would explain later, but that I should know that it wasn't because he wasn't attracted to me and that it was not about another woman. Weeks pass and we talk about it. His response was: "If I did not care, I could have just slept with you." What exactly does this mean? Any suggestions as to what may have happened? Could I have done something so terribly wrong and not know it?!