EIIs, do you find that you are constantly getting disappointed in people?

I have trouble reconciling people's actual actions with how I think they should act based on how they claim to feel, which always leaves me feeling like they don't truly care enough until they do something else that proves otherwise. This is a constant source of deep pain for me, which I'm afraid makes me come off as a grouch or someone that gets upset over "any little thing" (not little to me), when in reality it isn't anger but pain and disappointment instead.