Several of these really need to be generalized. We're getting male/female/black/white/asian/etc. variants of everything, needlessly complicating the system. Unicode has inflection support - just mark that 'male' or 'female' is an inflection, like an accent mark. Combined characters, for one glyph.
And yes, that means the 'standard' is gender and race neutral. People might make assumptions; deal with it. It's better than doing 'this is a smiley, and this is a female smiley'.