To blazes with your brother. It's your life and your decision. Do what you think is best for you. If that means moving out, and he doesn't like it, then tough cookies.