All of these boomers which have given me everything good I have in the world and a safe place to indulge myself in insulting them say we need to limit AI research because AI will "kill us all".
FTFY
But here we find the real danger - people who wantonly deploy AI without realizing the limits it has,
Which means everyone, including you.
That's one problem, but hardly the only one. The "training" materials are effectively a closed loop of reinfocing the correcteness or flaws of the training materials, partcularly when it comes to LLMs. The Microsoft Tay fiasco is an early example.
In one way, it's no different from raising children, who inherit many of the proclivities of the parents. Unfortunately, with AI, that might take 18 minutes instead of 18 years. At the same time, most of the training is being done under the "tutelage" of people and systems whose capabilities for teaching future good citizenship are exceptionally dubious.