It was the first wearable AI pin, sort of like a star trek communicator. And it was terrible.
 
But every time someone writes a 500 word article about those two facts, it gets a million clicks and tons of ad revenue, so they're gonna continue to do it until people stop clicking on the headline.

The real market is investors. He's seeking a $6B valuation on x.ai, which is just nonsensical vs. what they're offering.

How is a flow chart...

You stopped after reading two word and ignored every other word in the post. *eyeroll*

Predicting words is just about resonance

The word "resonance" is a non-sequitur in that sentence. You might as well have written, "Predicting words is all about Australopithecus."

For me it's the Final Fantasy II trap.

As a kid, my first run through Final Fantasy II, I had gotten like halfway through when I hit a fairly difficult area, and I was getting tired of the fights, so rather than spending time leveling up and whatnot before going there, I just increasingly started making a habit of running away from enemies. And it worked great, I got further and further and further, really quickly. But my level correspondingly fell further and further behind what it should have been for the area, to the point where ultimately I could no longer beat the bosses and advance further.

"This is the taboo question that no none is allowed to ask, because everyone already knows the answer, and the answer is not the evil racist white man."

In fact that often IS the answer. Nations were destroyed with colonialism, and racism was literally invented to excuse it. Many have also been deliberately suppressed since through various foul means including sanctions, backing coups, and outright assassination. That answer is the real taboo, especially if you ask the governments responsible.

It's called RAIL.

No, I am not seeing that at all. I see plenty of cops. I see some every day that I go out.

Lolol modded down by someone who knows nothing as usual.

"AI" is not thinking. It chews up data and shits out data. If the shit is valid it's only a coincidence.

He comes up with the most mind-bogglingly stupid ideas based on how twisted his conception of reality has gotten. Basically, in his reality, news articles are probable lies, but people who get lots of likes on Twitter are probable truths.

Nobody knows how to do that, at least not for a model of useful size. It would have to be reasoning in order to explain, but they aren't doing that.

Good to see we're abandoning the premise that the logic behind LLMs is "simple".

LLMs, these immensely complex models, function basically as the most insane flow chart you could imagine. Billions of nodes and interconnections between them. Nodes not receiving just yes-or-no inputs, but any degree of nuance. Outputs likewise not being yes-or-no, but any degree of nuance as well. And many questions superimposed atop each node simultaneously, with the differences between different questions teased out at later nodes. All self-assembled to contain a model of how the universe and the things within it interact.

At least, that's for the FFNs - the attention blocks add in yet another level of complexity, allowing the model to query a latent-space memory, which each FFN block then outputs transformed for the next layer. The latent space memory being.... all concepts in the universe that exist, and any that could theoretically exist between any number of existing concepts. These are located in an N-dimensional space, where N is hundreds to thousands. The degree of relationship between concepts can be measured by their cosine similarity. So for *each token* at *each layer*, a conceptual representation of somewhere in the space of everything that does or could exist is taken, and based on all the other things-that-does-or-could exists and their relative relations to each other, are transformed by the above insane-flow-chart FFN into the next positional state.

Words don't exist in a vacuum. Words are a reflection of the universe that led to their creation. To get good at predicting words, you have to have a good model of the underlying world and all the complexity of the interactions therein. It took achieving the Transformers architecture, with the combination of FFNs and an attention mechanism, along with mind-bogglingly huge scales of interactions (the exponential interaction of billions of parameters), to do this - to develop this compressed representation of "how everything in the known universe interacts".

The systems do in fact allow you to choose less than 3 seconds' following distance. People are literally complaining that the system won't let them drive unsafely.

The faster you go, the more space you need between cars to maintain safe following distance. If I have a safe following distance between me and the car ahead, if someone merges into that space then I no longer have safe following distance, so now we need even more space. At commute times there is not enough road available for all the cars to have safe following distance at speed. This is what happens on any overutilized road. If you wait for that much distance to appear then traffic backs up at the point of entry.

What is "a few" about 316 billion parameters, let alone before you exponentiate their interactions?

What is "simple" about the extremely complex interactions of 316 billion parameters?

Honestly I question how much of the training was actually done with Twitter data.

It certainly was a source, but I seriously doubt it was the only data or even majority of the data.

Either way, doesn't really matter with RAG. RAG doesn't have to "know" much, just how to summarize things others have written.