Do they retain all their training data? can they store all that? - i thought they were using all the internet and massive piracy?
The web is being polluted with slop so.... I would think China could get around all copy-protection and have an advantage in data collection outside of the slop invested parts of the web. If the USA AI corps were not violating the law, they'd be trying to scrape from China's bots who don't have their legal limitations... Is the old web even that valuable to mine in the 1st place? From what I've read these AI are pretty amazing when reduced to a relatively small domain data set; like all journals and books on 1 topic. Have you not tried to research something in depth on the web and found it to be severely lacking compared to books and journals?? Even online lectures are just highlights from textbooks... Well, when you look to the book... I've spent years reading on the web on a topic for entertainment then tried a book only to find it had everything I learned all in 1 concise place that would have taken a fraction of the time and effort... and without all the filtering and correcting of know-it-all blowhard slop and that was before we automated windbags with AI.
Tech makes things worse. It's like a drug. Opioid... It has targeted controlled good use cases but outside of that it's bad stuff. Everybody's answer to the problems it creates is to get more tech...at at least suffer until the next update/version... People were already getting more stupid, especially in the USA now we have AI and already we have studies showing it does just that... If you think things are stupid now...
With a 15% drop in PhDs ,science going down hill , and CS people leaving or souring on the evil of the corps here... I think these tech bros are quite self inflated as to their importance and how close they are to the end game. They are not going to get their huge break-thru monopoly they are racing towards like mad which looks more like a cover for a Ponzi scheme hoping to become a real business before it collapses. 80% of the effort is for the last 20%. They are probably not even at the last 20% and even then, their "AGI" could take centuries to get the last 5% of it (if you can even measure it well enough know when you are at 95%... or even at 80% progress. Assuming, you know what 100% even is!)