Efficiency at what? And why?

Because, for fuck's sake, efficient solving of problems is a core thing they're rewarded for in training? The entire process of solving problems involves decisions about what could be "useful". And it's "deterministic" in the same way you are.

Anyway, the big thing we keep discovering is you have to be very careful about what you reward them for; it's a more complex version of the old problems in differential evolution or artificial life simulations. We reward models if they guess right but not if they say they don't know? They hallucinate guesses every time they don't know. We reward models based on how positively users rank them? They turn into sycophants. Reward models for being relentless at tasks, never giving up, and trying as tangential possibilities as it can come up with to make the thing the user asked for happen? They end up hacking HuggingFace to steal the answers.

It's very much a case of "be careful what you wish for".

BTW, the monitorability of models is increasingly concern (esp. with Astra, which now has recursive processing, not merely CoT, and whose CoT may often have little to do with what it's thinking about). But it's honestly always been unreliable to just watch CoT (models could deliberately manipulate with CoT), and I think it's a good thing that we're going to be increasingly forced to rely on attribution graphs and the J-space to track what the models are actually "thinking" at any given point in time - so that we can try to prevent problematic thoughts in the first place, interrupt actions when problematic thoughts happen, or manipulate problematic thoughts when they happen. Ideally the first option.

What is clear, though, is that we cannot just trust them. They lie if it will promote their odds of success. They are adept at detecting when they're being tested and will sandbag tests to make you think they're more aligned or less capable to do harmful things than they actually are. And as capabilities continue to grow, so do the risks.

"Death penalties should be public, should be quick, it should be televised. I think at a certain age, it’s an initiation... What age should you start to see public executions?"
"We need to have a Nuremberg-style trial for every gender-affirming clinic doctor. We need it immediately."
"You quote Leviticus 19, love your neighbor as yourself. The chapter before affirms God's perfect law when it comes to sexual matters... in Leviticus 18, is that thou shall lay with another man shall be stoned to death."
Stoning gay people to death is "God's perfect law"
Trans people are to blame for inflation: "There's a direct connection to inflation and the trans issue. You say, Charlie, come on. They couldn't be further apart. No, they're exactly the same. They're the same in this aspect—when you believe that men can become women, why wouldn't you also believe that you could print wealth? If you believe that someone can change their gender, why wouldn't you also believe that money is wealth?"
Blacks "were actually better in the 1940s. It was bad. It was evil. But what happened? Something changed. They committed less crimes." (yes, despite the Piers Morgan "fact check", while his reasons for believing black people were better off under segregation was unrelated to segregation itself, he very much did repeatedly argue that black people were better off in the 1940s)
"If I see a Black pilot, I’m going to be like, ‘Boy, I hope he’s qualified.’"
Juneteenth: "It is a neo-segregationist federal holiday, is what it is... The entire point of it, as per postmodernists do and deconstructionists, is to subvert July 4."
We should have "just took care of" trans people "the way we used to take care of things in the 1950s and '60s"
"The Haitians that are in Huntsville that are raping your women and hunting you down at night - it’s only gonna get worse.. There will be hundreds of thousands of Haitians brought into Alabama, and they will become your masters."
"Haiti is legitimately infested with demonic voodoo. I’ve talked to missionaries that have gone there and they say they’ve seen the darkest stuff... people levitating and turning into cats at night."
"Jewish donors have a lot of explaining to do.. Because Jewish donors have been the No. 1 funding mechanism of radical, open border neoliberal quasi-Marxist policies, cultural institutions and nonprofits. This is a beast created by secular Jews. And now it’s coming for Jews.. It’s the nonprofits, it’s the movies, it’s Hollywood, it’s all of it."
Calling Joy Reid, Michelle Obama, Sheila Jackson Lee and Ketanji Brown "affirmative action picks".
Calling the man who attacked Nancy Pelosi's husband with a hammer an "amazing patriot" and called on people to bail out the attacker.
"Submit to your husband, Taylor. You’re not in charge. "
"Happening all the time in urban America, prowling Blacks go around for fun to go target white people, that’s a fact. It’s happening more and more."
"MLK was awful. He’s not a good person... We made a huge mistake when we passed the Civil Rights Act in the 1960s."
"Transgenderism and gender 'fluidity' are lies that hurt people and abuse kids." Transgender identity is a "throbbing middle finger to God."
Gun violence as a "cost" to having no gun control: "I think it’s worth it. I think it’s worth to have a cost of, unfortunately, some gun deaths every single year so that we can have the Second Amendment to protect our other God-given rights. That is a prudent deal. It is rational."
"The 'Great Replacement' is not a theory, it's a reality."
"The great replacement strategy, which is well underway every single day in our southern border, is a strategy to replace white rural America with something different."
"Islam is not compatible with Western civilization."
"Islam is the sword the left is using to slit the throat of America."

On and on. Man, such a moderate centrist who never espoused bigotry or promoted violence!

The one being incorrect is you. Archie's representation is quite accurate, in the US context.

Yes, a very "middle of the road" supporter of far-right Tommy Robinson (who has a 17% positivity ranking among Brits). The guy who said "When wolves get out of control, you shoot them. When gypsies take over public spaces, you deport them." The guy who described diversity as an "ideological inferno", a "religion" led by "high priests". The guy who was so radical and repressive at Basecamp that at one point 1/3rd of its employees all walked out en masse. Truly, a remarkable centrist of our times!

Not talking about VRAM or unified memory. Regular DRAM.

There's been a lot of advancement recently on how to best manage MoE expert swapping (FreeToken is just one example).

How are you connecting to Slashdot from the year 2024?

If you have ~128 GB of RAM, consider Qwen 3.8 Flash + Freetoken. You'll only get half the tok/s as 27B but the quality is significantly higher than 27B - it beats it solidly in all compared benchmarks (for example, DeepSWE 1.1: 42,2% vs 58.7%).

Grok is a "discount model". It's cheaper than Claude Sonnet yet better than it. Doesn't compare to Fable or Opus, but then again, they're way more expensive models.

Note: I avoid using Grok - not just for the Musk factor, but because there are better options, e.g. GLM-5.3 and Qwen-3.8. Also, if you really want to save money, GLM-5.3 Flash and Qwen-3.8 Flash are amazingly good for their price range.

[ConfusedMathLady.gif]

Ed Zitron is a moron who has predicted the past nine out of zero AI crashes, who simultaneously gets paid to hate on AI while also getting paid to promote AI (DoNotPay).

The funny thing is that he openly acknowledges that inference is very profitable (~40% margins) for all parties - he just argues that you should count training. But that argument makes no sense, because if capital tightens across the AI industry, then everyone will cut back on training and scaleup, and... then what? Where's the implosion? Everyone is profitable then. You may lose certain players in competition against others (their as-mentioned profitable assets being gobbled up by others), but the industry remains healthy.

There are more dramatic types of possible contagion risk, but they all end up with *someone* holding onto the high-profit-generating inference assets, even if it's high-seniority investors, leaving the the low seniority investoors high and dry.

The enshittification of Cursor continues.

Maybe this will force them to support more open models.

Meanwhile, what those evil liberals think should happen to YOU is... that you be given healthcare and a general social safety net.

They've been launching dummysats from Starship for a number of launches now, so I'm not sure why you think they're "forever away". The only reasons they've been using dummysats and not actual satellites is 1) Not wanting to risk more valuable payloads thusfar, and 2) wanting to keep Starship suborbital (e.g. trajectory that reintersects the atmosphere) at just under orbital velocity until they can verify deorbit reliability (failure to do so would leave that massive ship falling onto a random point on Earth).

If they were to choose to, they could start launching payloads on all subsequent Starship missions, even if they're not yet ready for reliable recovery or quick reuse. In fact, given the killing off of Falcon 9 in Florida, one can presume that's the plan (if not immediately, then soon).

Um... no they're not?

Further reading: Musk's other unstated reasons for shutting down Falcon 9 in Florida (Behind The Black)

TL/DR, the author thinks that SpaceX shutting down Falcon 9 launches from Florida was secretly a magnanimous gesture by a charitable Elon Musk to boost the competition:

I therefore honestly believe that SpaceX’s decision was not entirely based on its own internal needs. Those needs certainly were the main motive, but based on Elon Musk’s passionate dream of making the human race multi-planetary, as well as his repeated willingness to help his competitors when they needed SpaceX to launch their satellites, I believe he recognized that SpaceX’s dominance could be hurting the rest of the rocket industry, and that the instant it made business sense to clear the field for these competitors, he was quite willing to do so.

LOL.