Comment Re:Is it much different? (Score 1) 77
Yes, but you can eliminate that bias. I would actually be VERY careful about using AI to make personnel decisions. But if you control the whole stack it could be done safely. Start with a fresh model, train it with the performance metrics and valid data points ONLY, and make sure to DENY it ANY data on membership in protected classes. You would have to go the extra mile and anonymize all PII... make sure that there are no names in there that could give a clue to national origin or gender or such. Theoretically you shouldn't need to if you deny it the class memberships in the first place. But it's best to do that extra due diligence anyway. Models can make some weird connections.
But at the end of the day, an AI model that never knew someone was gay, still doesn't know that they're gay, and has no way to find out they're gay; can not recommend that someone be fired for being gay. And being gay (or black or female or from another country or whatever) is not a shield that prevents you being fires for malingering or incompetence.