That's not really correct... we don't get off fucking peoples feelings... just fucking people.
I don't know about others but I am one hedonistic guy... inside a relation I am faithful but if I don't perceive myself as being with someone, anything is permitted
Your current problem was probably created by you ending up wanting more than sex and he wanting only sex.