I identify with this. I say I'm bisexual, but the fact is that intercourse with men does nothing for me. It doesn't hurt (after the first time), but I get no more pleasure out of it than I do out of inserting a tampon. I read up on it, and the vagina is pretty numb. Most women need clitoral stimulation, but a lot of straight men don't understand that. Also, I like looking at men except for the genitalia.
I would like to try sex with a woman, but women in general are not interested in me. I tried online dating as bisexual, but I only got interest from creepy straight men and couples. Some men seemed to think that "bisexual" means "nymphomaniac" I'm not sure what the solution is to your problem, but I do understand what you're going through.