You will be okay - just don't talk to anyone you feel you can't trust.
I understand the conflict of interest and your concern because they live near you. Let them be intrusive an laugh, its a signal of their own disrespect for others and has ZERO bearing on you.
Stick to yourself, those you trust, if you need emergency help and there are any red flags with the people you speak with in that arena, just tell them you cant provide them with info but you will inform a trusted professional upon hospital appearance.