Socializing is becoming increasingly difficult

I'm here with my life partner Matt. He's the only one I can seem to trust with his family. My mother I can only trust so much since a lot of the time she doesn't like talking to me in general and is very critical and harsh. My two fathers. One biological in prison who I have to take everything with a grain of salt because of his history. My step father who has an alcoholic, can not be that nice at times.

I find it very hard in general to make friends with other women my age. They always seem to want to gossip, get high/drunk, have sex with as many men possible and end up in broken relationships. There always seems to be animosity with these women, it feels like I have to compete with them for no reason at all. All I want to do is talk and be friends, but then they turn there noses up at me as if, "Oh my god, why is this weird awkward ***** talking to me?" I swear I'm not making this up, because it's happened before. The very nice and practical women who I do share in common with, you'd think things would work out for us? They reject hanging out with me, make excuses. Am I that bad of a person? What am I doing wrong?

The men, I don't even want to start with. They cat call me, tell me to get in the car with them, try to ask me to go out with them even when I'm in a relationship with my now boyfriend. Worse is when they spit at us and try and start a fight with him just because they see me with him. What the ****?

My loving partner has noticed that I am not my usual self, I don't talk as much. However, it's because I feel like I'm losing connection with everyone. There seems to be no trust with people in general, no one wants to talk with me. I don't judge, all I want is to be with positive people who want to have a fun, healthy life. Not something in addiction, bad habits, and negativity. I feel like I can't find that anywhere. I honestly feel alone even with Matt. I feel all alone with Matt. I love him very much because I can rely on him, but it's becoming hard for me to socialize with others.

I'm tired of being compared for my looks, and wit to other people. I just wish people didn't judge me because of that.

Edit: A lot of the time I feel scared to go places without Matt. Without him, I don't feel safe. Without an escort. I feel unsafe, that something bad is going to happen to me. These feelings have been increasing within the past year. I don't know why this is happening.

I understand the loneliness. I don't really have friends I can hang out with. I have no idea why, other than my mental health leaves me quite off the norm.
Here's what's up though. I have zero idea what you look like, nor you I, but I can and will hang out with you online. As friends. I have no interest in starting a romantic relationship and have some decent moments of positivity. Most of my good, nee great, friendships have been with women, but that's only because I find overall they can talk about anything, and guys have that machismo in the way of being meaningful. Message me anytime.