Probably because you suffered pain or a perceived disadvantage at some point early in life as a result of some aspect of you that is specifically male. Could just be massive garden-variety castration anxiety, especially if you are a very physically sensitive person. Are you circumcised?