Forgot your password?
typodupeerror

Submission + - Regulating AI Like Aviation or Nuclear Weapons (yoshuabengio.org)

puzzled writes: Yoshua Bengio, the founder of LawZero, "a nonprofit startup developing technical solutions for highly-capable, safe-by-design AI systems", recently addressed the U.N. Security Council. The AI companies themselves are positioning their work as a potential existential threat, and Bengio argues that they should be subject to a similarly strict level of regulation. The Nuclear Regulatory Commission would not even issue General Electric a permit to build a breeder reactor in 21st century America, but Anthropic and OpenAI's creations are running wild.

We had the wisdom to stop atmospheric nuclear testing after the 1954 Castle Bravo incident, but that took until 1963, and we have incrementally reduced total nuclear weapons since 1991 via the START treaty and its successors. AI is moving at internet speed; we need results here in months or quarters, not years to decades.

Comment imminent nationalization (Score 2) 90

The AI bubble bursting will wreck the economy far harder than the Dotcom bubble did. And the dynamic is OBVIOUS. This is not an "if" problem, it's a "when" problem.

If AI produces a maximal result along the lines of what the frontier labs suggest, it'll eat fifty million jobs, which will wreck the economy far harder, and for far longer.

The constant chatter about AI breakout is half legitimate concern and half positioning to nationalize it, shielding the circular dealing crew from consequences.

This will not be Skynet; as a society we are far too primed to envision events that can be told in a single two hour action adventure with a clear, satisfying ending. When the historians get to this they will note the breakout happened 2025 - 2027 -- because that will be the time where human network threats enhanced by AI will starting further enhancing AI.

There are no "sides" to this, it'll be like the African savanna - lions, leopards, hyenas, cheetahs, wild dogs, servals & caracals, clear down to my personal favorite, the black backed jackal. A network of carnivores of various sizes pursue networks of herbivores. Nation states, corporations, non-state actors, activist groups, talented individuals; all are making use of AI in conflicts already.

The genie can not be put back in the bottle, the open models are only a little behind the frontier, and things are going to keep happening no matter what bellicose policy pronouncements come from an increasingly irrelevant Washington, D.C.

I'll be riding the Claude subsidy until it ends, then hopefully have acquired a potent professional GPU or unified memory setup of my own. Won't be nearly as quick, but it'll keep me moving.

Now scale that thinking up by whatever percentage of eight billion people have technical capabilities. That's the future.

Comment Avoiding bubble collapse consequences (Score 4, Insightful) 372

The AI industry has blown a spectacular bubble via circular dealing - Nvidia, OpenAI, Oracle, Microsoft, CoreWeave, etc are all doing monopoly money deals. Nvidia "sells" some GPUs, then "invests" the proceeds back into OpenAI, nothing got done, no money changed hands, but their stock values zoom. This looks exactly like the Dotcom bubble in the late 1990s and such things always implode - the market doesn't just correct, it panics, it liquidates, nobody can tell what's real, so everything is for sale at pennies on the dollar.

The industry's strategy to not go to prison for this stunt is to make AI equivalent to nuclear weapons. When the bubble begins to burst, the Trump administration will "make a deal", what you see is the beginning of that process. This will work about as well as the attempt to shake down Iran for their oil, but cause and effect are not the Trump administration's strong suit.

Comment the danger is real, even if this is marketing (Score 1) 167

We're playing with machines that we don't fully understand, which can move faster than we can, and we're giving them more and more autonomy. AIs don't have to kill ALL humans for us to legitimately begin to worry. A black swan event where a bunch of automated systems all suddenly begin maximizing the wrong expectation value at the same time could cause a massive global catastrophe so fast the damage would be done before anyone even knew it was happening, let alone be able to halt it.

Comment Real easy solution to this (Score 5, Insightful) 61

Two [candidates] said explicitly in filings that they had used the subscription for advertising, even though the company's policies prohibit candidates from using their tools to generate ads

If the AI companies want to guarantee their AI does not get used, they could add text to their EULA that says all data discovered to be connected with political campaigns or super-PACs will be made public and searchable, including contact and payment information. Boom, nobody would touch it.

They won't, of course, because they secretly LOVE the idea of pollical campaigns using their tools, but man, wouldn't it be cool if we have heroes instead of villains in the AI space?

Comment Conversations (Score 1) 120

"How did you get hired?"
"I was top at Fortnite. You?"
"Combat flight sims."

"Damn, two Boeings just crashed over an oil refinery on city limits and took out half the city."
"Did you remember to save your position beforehand?"
"Yeah."
"The reload and continue from there. No-one will notice."

I love computer games. I have XPlane 12 and many scenery packs. I rank well on Elite:Dangerous. From the sounds of it, the FAA would see me as over-qualified. In reality? There's no way in hell I'd be taking those kinds of risks with real lives. There's a huge difference between having good reflexes and a good eye, versus having the complex 4D spacetime relationship mental models needed for robust air traffic control.

Comment Re:Need new AI editors (Score 1) 65

You see, Linus has embraced transhumanism and is testing out the new kernel as a supplementary brain function, using MOSIX to offload all of the irritable comment generation at yet more nonsense on the mailing list to an Elizabot that he has written specifically to do this. This saves his actual brain for real work.

Slashdot Top Deals

"The vast majority of successful major crimes against property are perpetrated by individuals abusing positions of trust." -- Lawrence Dalzell

Working...