Aww, man, I feel for you =[ I really do. This is horrible, to put someone through something like this! Ugh, the more I think about it, the angrier I get. It's as if they don't care about the other person's feelings... "don't call me, I'll call you" ?!?!? What the fuck... think about how confused and stressed you are making the other person.
To hell with this INFp, go and confront him, seriously. DO IT.