Do you ever look at strong, confident and well adjusted adults and feel envy that they didn't experience neglect, and that they had it so nice growing up?

It feels like a life long battle to be like everyone else and I think if I hadn't experienced so much neglect I could have been a stronger more successful and stable person. Instead I always feel like I'm weak, stupid and lagging behind, despite my best attempts to the contrary. Does anyone else think about this?