I've been married to a man for 32 years who still can't remember our anniversary date or my birthdate (or our sons' birthdates). In the scheme of things, it's a small thing and is actually a bit endearing after all these years. It's a running joke in our house. We have learned to just remind him. He isn't being insensitive; he just doesn't have a memory for such things.
Pick your battles. If otherwise he is a good friend, value that.