You don't "need" to do anything.

Is he a good doctor for your medical needs? Some professionals are really odd ducks in their personal lives but they are fantastic in their profession. Heck, we've even tolerated some medical specialists who had horrible bedside manners because their work in their specialty was superb and hard to find equal for.