Here is one example from one of the largest companies in the world - Microsoft.
AI moderation is currently being used in many Activision games. Activision is owned by Microsoft. People are getting banned from communicating for days simply because the AI didn't like what they said. Sure, this isn't life changing, but when this same tech gets rolled out to every companies communications and every forum, it will be.
Activision came out and said, "Yea, its broken, we'll tune some dials" -> https://www.callofduty.com/blo...
This same software is being used to monitor calls to call centers, help desks, comment boards, etc....
I'm not a gamer, but one example of a totally broken system based on AI.
The problem though is exactly what you said. People are going to say exactly what you said. The evidence is sparse as we haven't pushed it everywhere yet and people will say, "Show me evidence or we'll push it and maybe fix it when people complain."
The problem is that by the time people realize what is going on, the damage will be done and it will take decades to undo, if its ever undone.
Bookmark this post.
--
Technological progress is like an axe in the hands of a pathological criminal. - Albert Einstein