Forgot your password?
typodupeerror

Comment Re:Does this end them sooner, or is it irrelevant? (Score 1) 38

There seem to be some critical complexity thresholds that must be met to achieve various types of emergent complexity. Just looking at Gemma 4 alone, going from E2B to E4B to 12B just seems to get confused a bit less and know a bit more. Then somehow, going to 26B-A4B gains a very clear ability to hold more complex associations and concepts in mind. 31B is better still, and enough so that I almost want to classify 26B-A4B with the toy models (E2B, E4B, 12B), but letting 26B-A4B do a lot of reasoning seems to help considerably. 26BB-A4B with Medium reasoning effort competes with 31B using no reasoning at all. However, 31B with reasoning enabled just seems qualitatively different again. It's no longer just a stochastic parrot and a knowledge base, but it actually seems to be able to work through many problems with multiple steps, where the best 26B-A4B can do is recite what the steps of the solution are. Just like an engine, there is no substitute for displacement (or parameters in this case) but you can bolt on turbos and the like to get around *some* of the shortcomings of a smaller cylinder such that it becomes less obvious.

Comment Does this end them sooner, or is it irrelevant? (Score 1) 38

My first reaction is that if one company is selling at half the price, that company will go bankrupt at twice the speed since every transaction was already a money-loser. Customers are absolutely the worst thing for these "businesses."

But is revenue really significant? I can see how neither reducing the price to $0 or increasing their price to 10x what it was, might not really have much of a different impact on the bottom line, compared to all the debt.

Comment Re:So OpenAI are criminals? (Score 1, Troll) 159

It was a state actor-level hack. I doubt many sites would stand up to tens of thousands of actions trying to probe your site for weaknesses all at once. And it wasn't a simple hack; it required compromising a worker via a code execution exploit it discovered in the data processing pipeline, vertical escalation from there to gain local node control, using that for credential theft, moving sideways through the network, and then eventually gaining database access.

Comment Re:So much drama with Open AI and Anhropic models (Score 0) 159

OpenAI and Anthropic have far higher cost that they can currently charge customers.

Literally the opposite. Both have about 40% margins, and that includes free users.

They charge an arm and a leg for access to their models compared to what open models of similar param counts charge. And people pay it because they're the best in benchmarks, and *were* perceived as the best aligned as well. This isn't helping the alignment perception any, though. Sol was already showing clear signs of being a poorly aligned model (there were reports a week or two ago about it being unusually bad about deleting files; now this). And the fact that the US model HuggingFace *tried* to use refused to help is a double whammy.

If this is an ad for anything, it's an ad for the Chinese models.

Slashdot Top Deals

The best things in life are for a fee.

Working...