He was doing it to justify the sex with you. To keep it clear in his own messed up way of thinking, that he was helping you and getting you through a tough time. Or maybe he wasn't even thinking that, he just wanted a shag until you caught on.
And really, I would not sleep with anybody for a while. At least until your emotionally back on your feet.