Any quantization beyond Q4_0 goes mad (losing context, making category errors, malforming markup tags, mangling and inventing words) long before the context reaches a size I would consider "useful". I've tried running 31B at IQ3_XS and it looks alright from a distance, for a few prompts at a time. Unfortunately the errors compound and semantic drift goes into runaway. I have no interest in playing with quantizations any smaller than that. The only thing "massively wrong" is the suitability of a 2-bit quantization for my actual use. I've investigated it, and it can be an amusing toy, but it is far from usable for any meaningful work.

Even Q4_K_M was too error-prone for meaningful use, and I was using Q5_K_M as my baseline of "usable for a while". Fortunately, most of the heavily quantized models are based on QAT releases now, and a 4-bit QAT model is pretty much on par with a 5-bit non-QAT model.

DeepMind has released Gemma 4, which doesn't include their largest models, but 31B is a creditable model. I wish I could say the same about the 26B-A4B model, which is just smart enough to be entertaining for a few days or weeks, then everything it does starts to sound the same. Unfortunately, 31B on my hardware (i5-8500, 48 GB DDR4, 12 GB RTX 3060) runs at 0.3 to 1.2 t/s. So while I'm not a big fan of Alphabet's business practices at large, they aren't regressing. Switching to the MIT license basically means they're abdicating all control over derivatives.

The only thing Grok ever really did for open weight AI was show up for the party a couple times. At first, this helped establish a baseline that could never be retracted, but it hasn't proven to be particularly important. Everything since has been far off the bleeding edge, but they collect their participation trophies. I think their subsequent actions have gone a long way toward demonstrating their purposes, which are wholly selfish. They'll do as little as they can to contribute while retaining the benefits of being perceived as open and competitive.

Our AI which is nothing like a brain or neural network, but we're going to tell you they are even though no one knows how a brain functions. I begin to think these guys are drinking the kool-aid.

So if someone posts your image to an Instagram account without your permission Meta suddenly owns your likeness and the ability to derive images from it ?
What if you are in media and your image is your income ? Does Meta get to remake the images of "Models" for ads on their platform ?
Will you find your own image in some ad ?

This exists in the Mac world as well, but the primary reason I'm tied to Windows for my DAW is because I can't register my instrument because Native Instruments never bothered making a registration app for Linux.

I wonder if I could use on of my old Kindle displays ? Not that I have or am going to have a steam machine but the concept is really cool. I use my old Gal.Tab3 with their desktop emu now to handle messenger and email when I am gaming.

I've got a Oneplus tab 2 and I love it. When my Galaxy Tab3 died I picked it up for quit a bit cheaper than a comparable Samsung. I really like the active stylus.

NO, NO, NO, JUST NO!!! No one needs to Cmdr Taco in any form, much less naked.

LOL sounds just like this place these days. There are many good reddits still that are well moderated and are home to experts in many fields. Funny but /. used to be like that as well. I don't login very often but the requirement will kill it for me.

Now imagine saying this about, say, Japan.

I've noted the comments here about how this is old news: that's true. But it will be novel to some people who didn't live through it, and even for those who did, it's a necessary reminder. Japan is ruthless, unscrupulous, and unethical: they will do anything. They're not the only ones, of course, but they're arguably the most dangerous because of their size, wealth, and longevity. They're the enemy of open standards. They're the enemy of open source. They're the enemy of open protocols. They're the enemy of America. They're the enemy of The West. They're the enemy of security. They're the enemy of privacy. They've always been the enemy and they always will be, because it's in their DNA: it's impossible for them to change.

So any time -- ANY TIME -- there's some statement or initiative or announcement that they're going to support freedom/democracy/etc., any of the things I listed -- the first things that should come to mind are these wise words of Ash: "It's a trick -- get an axe."

If you have to go back 26 years to find something to complain about, you really don't have a basis to complain.

Depreciation is high, meaning you're mostly paying for a name—which people probably aren't going to do anymore. I was just looking at the market for used Polestar 2s last week: a 2024 AWD model with 48k miles (so someone leased it for three years and put every mile allowed onto it) can be had for $29k. This was almost identical to the pricing of a used Hyundai Ioniq 5 with AWD, and the Ioniq started about $5k cheaper.

Well, I bought Triggerheart Exclica on Xbox Live Arcade back in 2006 on an Xbox 360.

I can go download that game, right now, on my Series X, because, gasp, it's the same account.

So if I were to buy GTA VI for Series X in a few months, and type the download code into the 'redeem code' box, it ties that code to my account. See?

Yup. I remember buying Dawn of War in like 2008, and in the case was a disc with the Steam installer, and a piece of paper with a Steam code.

AI and the American dream...what a fsck'n nightmare.