Hmm... I think there are some parts of the relationship that you could have managed yourself. Under Model T, your constructivist nature means that you would determine when emotions are brought into play; I imagine this would manifest as some half-assed attempt that the ISFp responds to with real emotions. Well, maybe that's it.
That first quote reminds me of the unhealthy 7 description. If you're a 7, have a look at the Enneagram 7 growth recommendations and see if they help. Although the 7's need sounds sort of like , I'm not sure this is something an ISFp can do for you. Maybe she can help you along, if you keep her nearby while you help yourself.
If you aren't a Seven, do you have any idea where "you can't enjoy it because you are so worried that you won't" came from?