Virginity problem running in family

I am a 30 year old American male. My first thread on this forum was written when I was 29, about my fears about turning 30 and being a virgin. Not by choice, not by some sort of religious belief like abstinence, but rather just it happened that way without my wanting it to.

I did some research into my family history, in this case my mother's family history. My mother has also had problems with attraction like I do, and she was a virgin until age 27. My maternal grandfather (her father) was a virgin almost until age 50. In other words, even though I am only 30 years old, my grandfather was born before the end of the First World War. I remember vaguely about how family said that he had trouble finding a wife that it took him until his late 40s to do so. Both my mother and I have Asperger's, and whilst my grandfather had several mental issues including severe OCD, it is suspected that he had at least mild ASD.

Now, going back further, my great-grandfather (my grandfather's father) was born in the 1860s. He was in his 50s when my grandfather was born. I think that he got married in his late 40s. There is not much data after that, but there is a record that my great-great-grandfather (my great-grandfather's father) was born in the 1810s. So he was probably in the late 40s or early 50s when my great-grandfather was born. As no one who is still alive in the family would know, no one knows why he was that old when he finally got married and had children. In the 1800s, a man still single/virgin his 40s and 50s was probably looked upon as having missed the boat. In other words, I am 30 years old, but my great-great-grandfather was born during the time of Napoleon.

So I was wondering, is there something that my mother's family inherited and passed down (especially the males) that makes it so hard for us to lose our virginity? I remember my grandfather being quite anxious and tense, socially awkward and aloof, and I see this in myself and my mother as well. Is there something in our blood that makes us repulsive to the opposite sex?

Maybe I am overthinking this with my tendency to overanalyse things, but I just thought that this is more than coincidental, especially because my father's side of the family does not have this problem.

I have never heard of virginity-losing issues being hereditary, but it is certainly conceivable that hereditary social anxiety and awkwardness could keep people in your family from losing their virginity earlier on. I sincerely doubt there is something in your blood that makes you repulsive.