Catch up on stories from the past week (and beyond) at the Slashdot story archive

 



Forgot your password?
typodupeerror

Comment Re:media (Score 2) 43

"Secret trick destroys AI" is bullshit. What is not bullshit is that for less common tokens, the conditional distributions of their occurrence in language depend on a relatively small number of examples. This is not an LLM property, it's a property of the language data itself. Also known as the hapax problem. Any language generator, including LLMs, is constrained by this fact. It has nothing to do with the architecture.

In practical terms, this means if you have a learning machine that tries to predict a less common token from some context (either directly like an LLM, or as an explicit intermediate step), then the local output will be strongly affected if it sees a single new context in the training data, such as when someone is poisoning a topic.

There are no solutions for this in the current ML learning paradigm. The system designers can make the system less sensitive to the tokens in the training data, but this comes at a price of being less relevant, due to deliberately discounting newly encountered facts against a implicit or explicit prior. Your example falls in this category.

It is fundamentally impossible to recognise the truth and value of a newly encountered datum without using a semantic model of reality. Statistical language models do not do this.

Comment Re:It's not Lupus (Score 4, Interesting) 49

That was probably the right thing to do. It's called differential diagnosis, and it doesn't mean that the doctors didn't suspect Lupus from the start. They were being careful to rule out alternatives in order of priority.

If your Word document that you're writing has a grammatical error, it could be caused by many things, from a typo to bad autocompletion to hackers messing with your desktop or bad choice of language dictionary packs etc. You don't start the first treatment by rebooting the computer and replacing the whole MS Office suite. You first try a bunch of less invasive things.

Comment Re:Amateurs (Score 1) 111

Musk is not the only one who faked robots by having people in a room remote controlling them without telling anyone.

This company fakes it in the open. They literally tell their customers that there's a guy next door remote controlling the robot slave all day and night.

Apparently they think it's not at all creepy to have some unseen stranger wander your home remotely, pretending to be a machine servant.

I guess there's a market for that, right next to the market for parents who don't mind taking their underage kids to Disneyland so they can be followed around by minimum wage strangers in Mickey Mouse suits...

Comment Re:Possible in favor of open source (Score 2) 13

Open weights are a waste of time. What is required is all the raw source data plus training schedules and scripts. That's what open source means.

An open weight model is like an mp4 movie. They give you a compressed datafile and tell you to run it in your favourite (movie) player software.

Comment Re:Sun (Score 1) 25

Don't worry, Bill Joy said that JavaSpaces lets you do computations at any time and in any place, ie without the usual limitations on space and time.

Wait, did you hear that? There's a rumbling sound in my living room, it's like a vworp vworp vworp! BRB.

Slashdot Top Deals

Per buck you get more computing action with the small computer. -- R.W. Hamming

Working...