Yeah, people tend to go crazy with over-rationing when lost. Like people who die of dehydration in the desert who are found with water still in their water bottles because they over-rationed it.

Also, most people, stranded without cell signal, don't just leave their cell phone on futilely trying to contact a cell tower until the battery runs out. They shut it down and then turn it on at regular intervals to see if they then can get a signal (at a later time or different location)

Word don't exist in a vacuum. Words are a product of the universe that leads to their creation. To get good at predicting words, you have to get good at modeling said underlying universe.

Q* (A* Q-learning, aka iterative tackling of possible routes to solve a problem via perceived distance from the solution)?

Massively MoE, with cos distance between hidden states feeding back to provide the model with an assessment of its own confidence?

More "distributed" models where portions are more decoupled from others and don't need as much bandwidth, to make it easier to train and run on cheaper hardware?

Will we finally see a lower O() context memory model? Could we at maybe close in on O(logN)?

Non-Transformers based (Mamba, etc)? Doubt it, but possible.

PCN-based with neuromorphic hardware? I *really* doubt that, but it would be an utter game changer.

Will surely be highly multimodal from the start. I wonder what the full modality list will be, though...

East Germany by itself wasn't able even in principle to sustain a costly industry that depends for its survival on narrow specializations in many areas and quantity shipments

It was MUCH simpler to be a semiconductor manufacturer in that era, and overall global volumes were much smaller.

Besides, the real goal there, and elsewhere in the Eastern Bloc, was always one - supplying the military, so commercialization was never the important driver.

This is simply false. East Germany sought to be a leading global commercial supplier.

Finally, judging the effort as "total failure" is a bit of a stretch

Bankrupting the nation to produce laughably small quantities of inferior chips absolutely IS as bad as a failure can get.

Dresden today is the center of the so-called "Silicon Saxony"

Yes. Today. You may perchance notice that your maps no longer show an East Germany there which led this multidecadal mission to turn around the disaster that was the East German semiconductor push.

This has nothing whatsoever to do with "training", or even the AI. This AI is a RAG summarization model. It's only tasked to summarize the text presented to it. Google is passing it the top search results. It's accurately summarizing them. It's not tasked with evaluating them.

The AI is doing its job. The problem is the stupid task Google set for it: "summarize the top Google results together without any attempt to evaluate them"

I've seen maybe a hundred screenshots of "TeH gOoGlE aI sCrEwEd Up!!!" since the feature was released, and there were like maybe two that were the AI's fault (one with a math error, one with oversummarization losing context - both being fixable). The rest was just the stupid idea of the Google execs to do this in the first place.

Or, it could go down the East Germany route, who also decided it was going to become a global powerhouse in semiconductors; poured tons of money into it and employed the best industrial espionage that the world could offer to get ahold of entire foreign production systems...

. ... and ended up basically bankrupting the nation, because they just couldn't deliver on the strict chains of quality needed at every step of the long production chains, and could neither produce nor innovate fast enough to keep up with foreign peers.

They're spelled slightly different.

Also, AIUI, if all you eat is meat you get the runnypooze. You need to eat something with fiber in it as well.

Their money's more important to them than your heath is to you.

You know, if someone wants to take some sort of revenge against him, there's a much simpler way - unique to him.

His sister Annie is a sex worker in Hawaii who hates his guts (Sam at one point offered to buy her a house; she refused because she didn't want to be controlled by him). If a man really wants to stick it to Altman, he could literally... pardon the crass pun.... stick it to his sister.

I literally train AI summarization models. They're *excellent* at summarizing text. It's one of the easiest tasks you can give them, and only takes a lightweight model.

Occupational Therapy is what they call it when you wank under your desk.

Skin color.

They would greatly care if they play an entirely different movie that just happens to focus on the same themes.

And for those 1-in-100 other disks, which the developer didn't release but you broke into their office to steal, if you think the developers are liable for that and not you, try again.