Could it be that...they don't like being touched?
It's not just whether they like to control under what circumstances they are touched or they touch someone else, but the impression they leave on other people that they can't stand their hand being held for more than a few seconds or that they rarely give spontaneous physical signs of affection?
It runs counterwise to what it's atually written about the type but I have the vage memory of someone commenting on it a while back...