Correct me if I am wrong, but I what the doctors may mean when they do not wish to prescribe Wellbutrin for anxiety is that it has an activating effect, which can heighten anxiety as opposed to soothing it.
The activating effect is why a doctor should tell you not to take it after a certain time in the morning, as it can keep you up at night.
The chemical structure itself is related to some stimulants, similar yet milder than amphetamines.