To me it sounds like you're more upset that you're not sad than anything. That's why I said "sounds like weak "... regardless, if you're afraid that you shouldn't be with him, then maybe the security of being in a relationship is why you're with him.