Comment Re:Whereas the rest of us believe... (Score 1) 107
Popular opinion is poor evidence.
Popular opinion is poor evidence.
It's a research program so, yes "That doesn't mean LLMs *will* deliver AGI". But what are your grounds for being certain taht it won't?
Even if it were sentient, it would be acting as the agent of the company that was running it, so they would still be to blame.
If you don't like "reward", say "positive feedback". It means the same thing, except for being more formally defined.
LLMs cannot have inherent values, because they don't know that anything besides text exists. Specialized pixel editors have similar problems.
Robots will at least understand the the external reality exists, so perhaps they could have inherent values.
If things were to otherwise stay the same, then it would. They won't. Some descendant of "vibe coding" will become the dominant mode within 20 years. Probably a *lot* sooner. Next year wouldn't really surprise me.
Also, Rust is more complex to use than C, so a small program is much better in C. And a large program is probably better in either C++ or Python(with a lot of library calls).
I don't like Rust, so I'm probably not being fair to it, but I struggle to identify a good use case. (Personally, I'd rather use Forth than Rust.)
Note however "will be", not "is". It's not there yet.
Then you have the problem of getting the right standards.
Then you have the problem of getting the right specs.
Then you have the problem of getting the right problem.
There's probably an end to this somewhere, but I doubt that it will be in perfection.
Nobody can write safe code. People, can, however, test the code they write, and if there is a comprehensive test suite, fix it so that it works safely. Debugging is mandatory!
It sounds as if he was referred to the bar association evaluation committee. IIUC those are he folks that can do the disbarment. A court can only say "you can't be a lawyer before us anymore", but he'd still be fine in a different court.
No. Not "is generally", but rather "must be". If the software can decide to ignore it, it's not a kill switch. (OTOH, computers today don't tend to come with kill switches. Those would prevent remote wake-up commands from working.)
How long ago did this happen? The summary didn't list the date of the submission of the "testimony", but thing like this tend to take time to process, so I'm guessing that it happened well over a year ago. This make his claimed "honest mistake" due to ignorance believable. But it also negates your point.
That said, they won't be able to stop hallucinations without breaking the AI models. That's a mistake that people make all the time. What they need to do is prioritize having the AI determine how certain it's statements are, and including that in the statement...but people won't like that kind of answer.
OTOH, this sounds like one of the reasons I prefer debs from the standard repository over things hosted on other sites. Yeah, it's not perfect, but it's safer than lots of project specific repositories. (And it's one of the reasons I try to avoid Javascript, Go, and Rust.)
You're assuming they can't connect to a nearby open wifi net. Some reports have them doing that, though I don't know how valid those reports were.
Maybe not, but some are considering, e.g., salt water. Of course that's for "cloud brightening". And irrigation is already causing some areas to experience excessive salt in the agricultural land.
Nothing succeeds like excess. -- Oscar Wilde