It's tough being physically different. I'm tall and fat, used to work in local radio with the remote broadcasts, and people remember me. I don't remember them that much, because they don't look that different from everyone else, but I act like I do so I don't offend them. You get used to it.
Yeah! I've started greeting people with "We've met before...?" because I feel like people are disappointed when I don't recognize them.