Follow Slashdot stories on Twitter

 



Forgot your password?
typodupeerror

Comment Re:media (Score 2) 34

"Secret trick destroys AI" is bullshit. What is not bullshit is that for less common tokens, the conditional distributions of their occurrence in language depend on a relatively small number of examples. This is not an LLM property, it's a property of the language data itself. Also known as the hapax problem. Any language generator, including LLMs, is constrained by this fact. It has nothing to do with the architecture.

In practical terms, this means if you have a learning machine that tries to predict a less common token from some context (either directly like an LLM, or as an explicit intermediate step), then the local output will be strongly affected if it sees a single new context in the training data, such as when someone is poisoning a topic.

There are no solutions for this in the current ML learning paradigm. The system designers can make the system less sensitive to the tokens in the training data, but this comes at a price of being less relevant, due to deliberately discounting newly encountered facts against a implicit or explicit prior. Your example falls in this category.

It is fundamentally impossible to recognise the truth and value of a newly encountered datum without using a semantic model of reality. Statistical language models do not do this.

Comment Re:Plastics and oils (Score 1) 69

Green energy requires oil based plastics and oil based chemicals

Not really. Plastics require hydrocarbons that can be sourced from anything, including coal or wood. Oil is just the most convenient source, but it's certainly not the only one.

And anyway, only 6% of oil is used for plastic production. Even increasing the demand for plastics won't materially affect oil consumption. Fossil hydrocarbons are also used as a feedstock for other industrial processes (fertilizer production mainly), but adding up all these uses accounts for just about 15% of global production.

Comment Re:Stable Coin (Score 1) 62

No. Economy is movement of value, not of money. That's just speculation.

As little kids in a socialist country, we got fed the following tale:
Heating fuel in a mining town was very expensive. So the protagonist took a cart and a friend, went to the other side of a forest to buy wood cheaply, and with much effort, hauled it home. When asked why he won't haul another load and sell it at home, the guy answered: "I'm a worker not a speculant".
Abstracting from the nonsense of the price difference of wood being so high on two sides of a forest, the commies who produced this piece of propaganda inadvertently produced a nice example why trade is good despite not producing something by itself: the value it creates comes from moving goods to where they're appreciated (ie, needed).

Thus: economy is the movement of value (goods, services) between different owners who value those goods and services differently.
On the other hand, movement of money or similar tokens (eg. a wash trade) isn't valuable by itself.

Slashdot Top Deals

The trouble with being punctual is that nobody's there to appreciate it. -- Franklin P. Jones

Working...