Could it be you are Type 4 in the Enneagram?
As far as I know, it is a very common theme for Type 4s to feel like they are the "alien" or "black sheep" in their family.
(I absolutely relate to that, for instance.)
This is probably not related, but since we recently talked a lot about being e4 I resonated with what you wrote.