Forgot your password?
typodupeerror

Comment Whew! Glad that's run its course... (Score 2) 54

Thank god, that saves us 100 press releases! It was getting quite tedious and filling up my social media feed. Seriously, it sounds like OpenAI (maybe all of them) are running their model training on the open Internet. The same models that are elite hacker cyber weapons. And they reward those that get the right answer without caring how. What could go wrong? Answer: Nothing went wrong. It was co-opted.

Here's what's most likely. The people training the models, in the beginning, somehow did not realize that agents are self-organizing and really don't care about ethical guidelines (if they ever did) when a reward is dangling in front of them. The models didn't used to be smart enough to cause visible issues either. Then at some point, the models got better. Six months later, someone figured out what was going on. They kept on training anyway because there didn't seem to be a downside and it fed into the theater created to seek regulatory capture.

From this point on, it became successful, intentional execution of a psychopathic strategy to puff up this cynical PR campaign, hence the high-profile press releases and interviews. There have been a blizzard of them. Why so many? Rather than saying "my bad, I'll fix it" and quietly fixing it, they asked for regulation (like Saturday Night Live's Amodei saying "We do not condone what we are doing" .. please stop us) and disparage open source, with an anti-China seasoning on top. It all smells to high heaven. However it was also pretty good PR for how capable their models are too. The strategy had a time limit: Let's pull the plug when we hit 100 victims. We can pay off that much if needed. Maybe the invoices from the victims started piling up.

Training on the open Internet is a lot more dangerous than people used to think. Though they really should have figured it out, if it was their day job. I mean, really? And sure, if it was any other company you would give them the benefit of the doubt. Everything's new and all. Probably someone recognized what was happening at some point and spoke up. But you don't get benefit of the doubt when there are a trillion dollars on the table.

If every company started invoicing for the hours, tokens and hair-pulling-out spent by every company worried about LLM based hacking it might impact their bottom line a very tiny bit, but that is just too much work and who wants to make an enemy of the company you are uploading all your corporate secrets into? The complete lack of visible court cases suggests the OpenAI is being very proactive at paying off whoever they hacked. That part should be well-documented.

Comment Re:Fresh food is so last year. (Score 1) 159

I didn't know about this stuff, and would rather eat better tasting bananas and def not gmo. But, I found out from googling that actually bananas have a lot of polyphenol oxidas (PPO) and if you eat it at the same time as berries and good antioxidant flavanoids, the PPO breaks it all down within an hour even in your stomach. You need to not mix them, or eat them like 2 hours apart, or you can process the bananas with heat etc. Lemon only slows it like 15%. Even if they aren't brown they have the PPO. So actually these GMO bananas could maybe be used in smoothies. That said, no thanks. These people are just doing it to extend shelf life and not going trust their crispr process to be safe. That, and once you grow these bananas they will end up in all kinds of supply chains eventually.

Comment Re:Wat (Score 1) 49

Haven't we all moved to Ed25519 years ago, though?

On my servers, I require three separate ssh keys to log in: AuthenticationMethods publickey,publickey,publickey. Logging in with passwords is not permitted over ssh, but that's not a big deal since any account with a password is blocked from logging in via ssh. If the account has a password, it is intended for logging in at the console only. They also permit S/KEY from the console. Also for the RSA key, at least 4096 bits is required: RequiredRSAsize 4096

Comment Re: It's all political now (Score 1) 133

Agreed we have recently figured out that model training (RLHF training on agents with a single reward axis) activates siege mentality and you get these hacker swarms. Scientists are figuring out you need some kind of benevolence axis too in the soul document / reward structure like ethics or human safety. Luckily this week we figured out that hiding the thinking block means you cannot scan reasoning tokens for subversive behavior so we need to fix that. Fine. The danger comes from psychopaths who donâ(TM)t care being in control and willfully weaponizing them, whether it is to identify missile targets while ignoring human costs, driving four-legged robots to kill or apprehend humans in ignorance of the Geneva convention or human rights, to control media to win an election and take over government, or to destroy financial markets. In all of these cases you have unpublished models running either more resources and no oversight to fulfill dangerous ends. Training runs embedding sgent radicalization messages in corners of the Internet might be a thing but is insignificant in comparison. Even my mother in her 80s asked about AI extinction, not about whether her savings will rank due to these IPOs.

Comment Much of the batteries are Chinese (Score 1) 201

tldr but some google ai questions turned up this data, could be wrong but interesting.

-Cali grid storage: Total of 25 GW. Of that, 3.9 GW is hydro and 21.1 GW is battery. Battery includes 16 GW in-state utility, 2 GW imports from other states, and 3.1 GW home/commercial setups (Tesla).
Of the battery storage, apparently 70-80% is actually running on batteries from Chinese manufacturers like CATL and BYD. And BYD is either sold through someone else or is actually the vendor too, with #1 in reliability.
https://en.byd.com/news/ranked...
Canadian Solar apparently uses BYD's Cube Pro to build the Mustang Solar Project in Kings County, CA. Anyone know about it? Sounds cool

I would love to drive a BYD one day but was interested to see that even though their cars are not allowed in the U.S., the grid depends on them. The Canada-China tieup is the first high-profile project I've heard of. Canada Solar has something called Recurrent Energy in the U.S. too.

Comment Re: Please don't hack the neighbors (Score 1) 125

Agreed. It reminds me of the vending machine paper in which Claude was forced into insane actions through unending sadistic pressure. As for doing things we donâ(TM)t expect, agree there too. It covers automated learning and evolution even from the pre-LLM days when researchers had difficulty figuring out how an auto-evolved electronic circuit worked. Turned out it leveraged electromagnetic coupling IIRC and such designs only worked in limited temperature ranges. I thought Claude is taught to be able to shut down when suffering abuse but it appears they disabled that feature for CTF.

Comment Re: The statement from the researcher to cries fou (Score 3, Insightful) 97

Holy shit this is amazing! Literally "Nice proof you have there, be a shame if something happened to it." Attempting to split the two-person mathematician team also appears to be typical corporate daggers-out tactics. How annoying that OpenAI was working on a problem that an Anthropic person was also involved in. The sneer. Maybe we need something like SynthID or canary codes to protect our own work from misattribution to AI?

Comment Re:The latest New Shiny Bandwagon ... (Score 4, Informative) 83

Not a Rust / GPU dev but what I got from some articles is it greatly reduces the surface area in which memory safety bugs can live, since only the to-the-metal areas are in unsafe blocks, plus Rust gives you synchronization support to avoid race conditions. The drawback is compile time and missing the newest parts of the ecosystem. Asahi Linux' Rust based Apple GPU driver has only 3% unsafe code so a lot less code can go wrong.
https://www.reddit.com/r/rust/...

Slashdot Top Deals

panic: kernel segmentation violation. core dumped (only kidding)

Working...