This is an abusive relationship. Abuse is always about power and control over another. It is NOT about love. Abuse only just escalates statistically over time. He exerts control over you, he has been physical with you, he has become violent, and he isolates you -- all signs of an abusive relationship. It will only get worse over time. Leave this man ASAP however you can. Save yourself and your mental health!