Sometimes it is the silence that has us second guessing ourselves. I am like that at work. I hear nothing about my performance and thus assume it must be poor when the opposite all along is true and it finally took some sort of event or situation to finally hear it. So, I would still try to set your mind straight. "Gee are you okay with my hanging out?" "What can I do to assist you?" "Are you okay with my dropping by _____?"

Also, are you able to contribute in other ways? If you are there primarily over meal times then what if you were to say buy some groceries? Are you in a position to have these people over to your own place? It doesn't have to be dinner. It can be a simple as coffee, snacks, or drinks (if you are so inclined). I am an artist. While I went through a rough patch with depression I was helped by a family. I gave them one of my pieces as a thank you. Are you able at all to do the same?