That is the thing with spectrum diagnoses. The higher functioning a person is the more the person feels like they don't fit into either world.....BUT if you still have other problems related to the diagnosis it is probably correct.
It is better to have the diagnosis & know where those problems come from than not have it & wonder.