When I walk I wear a hat with a wide brim pulled down to shield my eyes from other peoples' gazes. I also wear sunglasses unless it's really overcast. I keep my gaze down toward the sidewalk in front of me (useful for avoiding stepping in something I wouldn't want to take home.)
And I carry big walking stick!
Nobody bothers me...