I'm sorry I don't think I know the answer to your concern.
Different people can have different informal perspectives with regard to what does or does not constitute gender dysphoria I suppose. But I don't believe what you are describing relates to the technical definition of gender dysphoria. Here are links to 2 articles, from PC's archives, on the subject of gender dysphoria:
Gender Dysphoria Symptoms
What is Gender Dysphoria? | Mental Health Awareness
By the way, you mentioned being asexual. So I wondered if you are familiar with the Asexual Visibility and Education Network. I'm not a member & I can't offer anything in the way of an endorsement. It's simply something I happen to know is out there:
Forums - Asexual Visibility and Education Network
My best wishes to you...