they might not find the other person familiar enough to want to interact with them enough (IME, this usually requires about two hours, in the case of the LIE-ESI duality) to notice the effects of duality.
Often people make pairs with the ones which they know rather more than 2 hours. It's people which study, live or work near, who are familiars of friends, etc.