It also could be that the species survives in perpetuity with reproduction of some but not all humans, hence not everyone is endowed with a significant sex drive. Plus, nature has introduced a lot of excess, a lot of extra padding - one ejaculation contains far more sperm than necessary for reproduction, so maybe on the other end of it there are people with low or no drive, because on the total there are more than enough opportunities for reproduction.