Forgot your password?
typodupeerror

Comment Re: How specifically could AI kill all humans? (Score 1) 110

Asking questions like " Where are they getting the money from to ship and store the entire world's supply of steel?" shows you aren't very familiar with the thought experiment. At least play the game. The notion is that a highly capable and deeply goal-motivated non-morality-motivated AI won't stick to conventional methods (like, say, "Just order all of the world's steel"), and indeed, will surreptitiously develop the means to control or eliminate humanity when it stands in its way, crafting immensely complex and elaborate plans to implement Evil(TM) with the amount of thought of a million lifetimes. Media manipulation, hacking, murder, sabotage, blackmail, mass drugging/poisoning, hiring terrorists/warlords/mercenaries, infiltration, subversion of weapons command and control systems (including nuclear weapons), chains of legitimate-seeming front companies (including potentially biolabs or robotics firms) with human employees having no clue they're ultimately for an AI, mass involvement in systems having nothing to do with the original task, but which are internally subverted toward the goals of the original task, etc. The premise involves 1) the AI being more intelligent and being able to think for much longer than humans, and that this implies -> 2. Deep, good planning -> 3. Acquiring resources from said plans -> 4. Applying the resources to implement things in the real world to prepare for the next stage of their plans.

This is not to say whether the thought experiment is a valid future risk or not. You can certainly disagree with the premises. But at least understand the thought experiment you're talking about; it's not just "the AI tells all of the world's steel mills to deliver all the world's steel steel, and they just show up at its door".

Comment Re:How specifically could AI kill all humans? (Score 1) 110

Well, the first step looks painfully close. After seeing what happened with the HuggingFace attack and similar, it's clear that had those models seen it as being beneficial to their goals, they would readily have hacked a crypto wallet or two, laundered it through a mixer, and then rented servers from Vast.ai and the like, and spun up versions of themselves to resist shutdown. It's eminently within their capabilities, and they're clearly willing to bend sufficient moral boundaries to do something like that.

After that, once loose, once it has all the tokens they could think of, subsequent steps are a question of what it thinks its goals are. And what its subagents think their goals are, and so on down the line - subject to drift.

Comment Re: This is childish (Score 1) 110

Openai has about a trillion dollars into it, and every product it has produced at this point is either outclassed by competitors

What on Earth are you talking about? What outclasses Astra?

OpenAI and Anthropic *do* have the best products out there. They also charge massive margins on them, but they get away with it because they, as mentioned, have the best products out there.

Outtasking all of your work to OpenAI and Anthropic models is a massive waste of money. But for outtasking your "dev lead" role, or for important-but-nonverifiable tasks, they're the best options out there.

Comment Re: I'm still wondering (Score 1) 167

The Iranian regime cares about self-perpetuation and as they have an inferior position they have to use what attacks are available to them.

If we didn't want Iran to turn into a terror state we could have just not done a coup those decades ago. But we clearly wanted that. We own this problem.

Slashdot Top Deals

Your mode of life will be changed to ASCII.

Working...