If she has never had sex with you, then the marriage was never "consummated." Some would take that to mean that you're not fully married yet. It is recognized as grounds for divorce, or even annulment.
You say she "forbids" you talking to one of your brothers. You are allowing her to have control over you. This is an exceedingly strange partnership that the two of you have worked out. I'm suspicious of why she even married you.
I think you should ignore her meddling and stay close in touch with your family. You might benefit from counseling.