I haven’t experienced what you describe but here’s some thoughts: when he asks for space give him the space he wants and needs. Let him come to you, don’t force him to talk or communicate and don’t follow him. Try to manage your anxiety yourself or with a therapist. The last thing you want to do is crowd someone when they want space. You need to respect their request and boundaries.