If you visit /r/facebook you will see dozens of people a day posting how their accounts are getting strikes and even banned in what appear to increasingly be
AI moderation utterly failing to be able to parse context.
Now, sure maybe some got strikes for real stuff they're not showing/saying but there's a clear pattern.
Anecdote is not evidence, but I've certainly had FB give me warnings over really innocuous stuff that in context was clearly not what I was being accused of
(to give an example, a friend posted an article about drug addiction and recovery and one of the quotes was along the lines of "... resisting the urge to shove my face in a cocaine plant" and I replied with that exact section of the quote and a "LOL, WUT?"
as in "that is a really weird phrasing"
the AI gave me a few days ding for "selling or promoting drug use"
I only got a restriction for a time but the reports of being perma banned are legion. (and yes folks have tried the appeal to no avail). The only ones with any luck are the ones who go and pay for meta verified then contact a real customer service who can sometimes reverse it
The wrongful strikes and bans sometimes even accuse the person of CSAM with about as much lack of context as the "cocaine plant" quote above...
So, I'm surprised this article is talking about it as if banning is this huge thing - as if the problem is how hard it is to permaban folks
Seriously its like they have this idea of what they do but are letting their AI moderators go off the rails without actually looking to see.
At this point I actually wonder if the AI is going off the rails but also somehow reporting /logging things in a way that is just making nice dashboards for the C-level folks to say "working as intended"
I feel like a total tin foil hat wearer even suggesting it, but with AI stuff often telling people what they want to hear regardless of .um .. facts... I wonder if it's reporting glowingly about the work its doing while the actual tools with rights to ban folks are going off on a stint that would make the "Church Lady" seem downright hedonistic by comparison