Forgot your password?
typodupeerror

Comment Re:This is fine but still, what a mess (Score 1) 71

That's when you remove a model's built-in guardrails. What they are probably talking about are 'sleeper agents' (from the Hubinger paper from 2024). Basically you intentionally poison the training in such a way that the model looks normal for most requests but for very specific requests it turns malicious. This could be anything from an intentionally faulty analysis up to triggering data exfil or causing damage with external tool calls (if the model is setup for them in the first place of course). It's all academic right now but also completely plausible. And trying to audit for it would be challenging since it's part of the model's base training.

You could also do this with post-training to an existing benign model but that's going to be easier to spot if both models, or at least the untampered base model, is publicly available for comparison.

Comment Re:So fellow wage slaves... I'm curious (Score 1) 116

Sorry but that is the answer, it's what internal CAs are for. If the devices truly do not support automation, and you need certs for them (do you really need them if this is a home or small office network?) then your choice is use public certs and live with the ever-shorter expiration requirements or put up your own CA.

Comment Re:Meanwhile, back at the benchmarks (Score 2) 25

So MoE doesn't save on RAM, it saves on compute. You still need to load the model weights into GPU memory otherwise you would cripple the model's speed since each token can be routed to a different "expert" and those weights would need to be copied from system to GPU memory when an new is expert called. Some people do it that way but they are community folks doing it for the LoLs and not anything running at the enterprise level. The trick Qwen-Flash-Next does is move their 51B N-gram embedding table into system RAM. That does save a decent amount of memory since it's 51B params you don't need to store in vRAM. That model's main weights are 125B params so it's a hefty savings to keep those additional parameters out of the GPU RAM.

Comment Re:Correct. And oh, no. (Score 4, Informative) 54

This looks like the final cell-phonification of the Mac. I'm bummed.

How do you figure that? From the Apple post: "Going forward, we will introduce additional controls to ensure that users who genuinely wish to grant an app this extraordinary level of access can only do so with very explicit user action. "

It's already a OS controlled permission today. You will still be able to enable it for an app if you really want, they just want to make tighten the gate up to make sure you really want to and don't blind-click though. Seems like a reasonable compromise to me.

Comment Re:Unbalancing the arms race? (Score 3, Interesting) 85

In the short term. Right now the bad guys (well, non-state bad guys) don't have access to frontier models with the cyber security nanny mode disabled. However open source models are getting better every day and most don't have those guardrails, and even if they do it's not impossible to remove them when you have access to the weights. So yea, short term it's going to be an issue.

Long term, however, once this initial tsunami is worked through then hopefully more of these types of bugs will be found before new code ships, making it harder to find critical vulnerabilities in the wild.

Slashdot Top Deals

With your bare hands?!?

Working...