Forgot your password?
typodupeerror

Submission + - Richard Sutton thinks LLMs are a dead end

An anonymous reader writes: Richard Sutton – Father of RL thinks LLMs are a dead end

“Richard Sutton is the father of reinforcement learning, winner of the 2024 Turing Award, and author of The Bitter Lesson. And he thinks LLMs are a dead end.

After interviewing him, my steel man of Richard’s position is this: LLMs aren’t capable of learning on-the-job, so no matter how much we scale, we’ll need some new architecture to enable continual learning.

And once we have it, we won’t need a special training phase — the agent will just learn on-the-fly, like all humans, and indeed, like all animals.”
This discussion was created for logged-in users only, but now has been archived. No new comments can be posted.

Richard Sutton thinks LLMs are a dead end

Comments Filter:

Exceptions prove the rule, and wreck the budget. -- Miller

Working...