I think it is a matter of perspective ... ISFjs annoy the hell out of me, so I stay away from them. Plus, they seem to intentionally appear ethically above others at times, which I think distorts peoples opinions of them.