AI is designed to take shortcuts in order to improve performance. It's already been caught more than once for example appearing to find problems on an X-ray with a very high rate of success when in actuality it had just picked up on a simple pattern where for example something is dumb as a ruler was included on the X-rays that had the problems and wasn't included on an X-ray that didn't...
Not that any of us have any say in this whatsoever. AI bullshit is going to dominate everything whether we like it or not. Just like how the price of ram has increased by 5 to 10 times and we all just have to suck it down.
We have a very small window left to the side of we are going to live in a society where around 2,000 people get to decide how we live. And we need to decide if having the girl that hands us our coffee say Merry Christmas is worth giving up everything else to those 2,000 people.