There is quite a chance that it could have to do with early childhood experiences. In my case it was for sure, as I had a poor attachment(anxious-ambivalent) with my depressive mother and a little kid. But there could be also other reasons for it. What helped me a lot to work with EMDR on this issue.