Not an ISFj or anything, but I'm sure I'm not the only person who has trouble looking someone in the eye while talking and/or listening to them. The problem is that I can't concentrate because I just start inspecting their face and eyes, and it is just distracting. So I usually put my ear closer and look away to listen. Speaking to I can usually keep eye contact pretty well unless I lose my train of thought.