Comment Re:In the long run it does not matter (Score 1) 30
Most likely the next step change in AI improvement will come from the next generation learning from today's LLMs and diffusion models. But not being trained on their output. More likely they will be evaluated by current AI.
AI advancements have a predictable pattern. First we mimic how humans do something, then we use those AIs to evaluate the next generation which learns how to do it without mimicking humans. LLMs have been trained on human output and work by trying to determine what a human would do in any situation. The next generation will most likely learn how to think and speak without ever seeing a word of human generated text. Now that LLMs exist to evaluate their output we have the necessary building blocks to design the generation of AI that can really produce content far better than any human.
We are living in the era of early-to-mid 90s chess engines, where AI learned from human moves and brute forced its way to barely beating the best in the world. It took 10 years from the point where chess engines could compete with top humans players until chess engines were effectively unbeatable. And those unbeatable engines were trained by other AI, not by looking at human games. It got to the point where looking at how humans played would have just made it worse.