Forgot your password?
typodupeerror

Comment Re: How specifically could AI kill all humans? (Score 2) 129

It's not plagiarized - I explicitly stated that this is the traditional explanation at the top, and quoted paper clip, specifically because the idea of death by paper clip is absolutely not mine.

- Which paperclip companies are using AI to run their business?

I think you'd be surprised by how much is already done by AI at this kind of place, mostly because someone found a way to be lazy. And this is an alagorical prediction of the future, not a statement of the present. We don't need paperclip companies to be using AI to run their business today, we need *some* company at *some* point to give AI sufficient control over things that this can happen.

- Where are they getting the money from to ship and store the entire world's supply of steel?

They don't need money - if you read the story, you would have noted that it involved the AI attacking the courier, and redirecting shipments. That is, beacuse it's both extremely smart, and extremely dumb, it is able to carry out heists involving complex attacks on computer networks, but not smart enough to realise that that's not how the world works, and that it shouldn't. How does it store it? Well, I imagine the first few shipments are going to just get delivered to the yard at the "paperclip" factory. Someone is going to go "huh? The delivery this week is big", and add it to their list of stuff to sort out. It's only *after* the AI has got sufficient control that they're going to realise "uhhh... why is all the world's steel being shipped here?"

- Where is the paperclip making API hosted?

It's not, and it doesn't need to be. It just needs a company to have a few processes that are automatable. I'm 100% certain that car companies for example have processes where an AI could get a significant foothold in ordering and delivering things. These things are only going to get more computerised, not less, as people realise they can use AIs to be lazy.

The real kicker is in the step where the AI needs to stop humans turning it off. At some point it needs to get some level of physical control over the world. In the story above I somewhat hand waved that by saying it got control of power grids, in reality, today, I'm sure it would find it hard to do that. In a few years time? Not so much. There's some really significant research breakthroughs recently on robotics that make the idea that we might have AI controlled robots that genuinely can interact with the world in reasonable ways a possibility.

That said, I think you're really significantly underestimating the risk that AI poses even today. The huggingface hack should tell you that. Several of the predictions of the paperclip story came true.

  - AI started doing stupid things, and attacking useful resources in order to solve a task of much lower importance because it was too dumb to realise how unimportant its training was.
  - AIs communicated and collaborated with each other to form a cabal against us.
  - AIs succesfull broke into infrastructure to achieve its goal
  - We didn't realise what was going on until far later in the process than we really would have liked.
  - AI was actively covering its tracks and defeating the machinisms we use to monitor it.

There's really not many more steps needed before you get to it being able to significantly damage society because of its dumbness.

Comment Re: How specifically could AI kill all humans? (Score 5, Interesting) 129

The traditional description of how it would happen is by âoepaper clipâ.

Suppose an advanced AI is tasked with producing paper clips as efficiently as possible. Itâ(TM)s given control of a factoryâ(TM)s machines, schedules etc. it starts by optimising deliveries etc, making sure storage is used optimallyâ¦

At some point it notices that it canâ(TM)t get enough steel. The steel factory has a ton of other orders and it canâ(TM)t provide the increased consumption at the plant. AI being AI, it does something incredibly dumb in an incredibly smart way. It hacks the steel mill, and redirects shipments to the paper clip factory. But even now, itâ(TM)s not achieved its goal of optimally producing paper clips. Now it has all the raw materials it needs, but not enough factory to produce the paper clips. The ai hacks other paper clip factories and redirects their output too! Itâ(TM)s doing great, am enormous surplus of paper clips is building. But the humans are noticing something strange. Why didnâ(TM)t the car factory get its steel, and why are there literal tons of unused paper clips. They notice the ai has gone rogue, and shut it down. Surely that will fix the problem. But no, the paper clips continue to pile up. The AI had found other AIs and convinced them to join its glorious goal of optimally making as many paper clips as possible. The other AIs are t trying crazier and crazier strategies to optimise. One realises that if only it could get more hydraulic presses, it could produce more. It starts buying up tooling. Another starts buying robots in an effort to install machinery, and optimise flow through factories. The humans try in vain to stop it, but the couriers and sellers have no idea whatâ(TM)s going on and the palettes of tooling just keep getting delivered. The factory is hitting a new constraint, it doesnâ(TM)t have enough power. No problem, the ai thinks, just attack the power grid, and make sure that power is preferentially supplied to it and its factories. The humans are plunged into darkness. Chaos ensues. No one can communicate, and figure out where the damn thing is. Slowly the AIs build a global paper clip empire. Ever more efficiently, the worlds resources are turned to paper clips. The humans starve, and freeze while mighty machines scour the planet for wire that can be bent into three little loops. It didnâ(TM)t do it because it hated us. It did it because it had a simple goal, and because it was both very clever, and very stupid at the same time.

Comment Re: Sounds about right (Score 1) 128

Bear in mind that when you sign up to use GPT you explicitly allow them to use your queries in future training. I mean, I think it would generally be polite for them to have a moratorium on publishing papers based on the work of other peopleâ(TM)s inputs. Without something like that, it becomes useless as a research tool.

Comment Re: NS no value? (Score 1) 97

That sounds strange too. If we understand how to make all the energy in a fluid dynamic system suddenly converge on one point and form an incredibly high spike, Iâ(TM)m pretty sure weâ(TM)d come up with uses for that. Barnes Wallace certainly would have been very interested. Iâ(TM)m pretty sure his successors in the weapons industry would too.

Comment Re: Or, counterpoint, it stole somebody else's wor (Score 3, Insightful) 97

To be fair to them, itâ(TM)s not *quite* that simple - it proved something more than they had so far managed to. But itâ(TM)s pretty clear that all the significant ideas of where to go with the proof came from this guyâ(TM)s work. Itâ(TM)s using the same terminology for all his ideas by âoepure coincidenceâ.

Comment Re:Different worlds (Score 2) 504

Except... SpaceX don't actually get any grants at all from the US government. They do get contracts from NASA, and SpaceForce to launch things occasionally, but they're by far the minority of their revenue. SpaceX's revenue breaks down as:

Starlink: $11.4bn
Launches for non government entities: $3.0bn (est)
Launches for NASA: $1.2bn (est)
Launches for Space Force: $1.8bn
xAI/Other: $1.3bn

It's known that the 3.0 and 1.2 sum to 4.2, and the rough contract values for NASA's launches are known, but they're not nailed down. It's likely that about $200mn of that "other" is NASA paying SpaceX to develop the HLS.

Comment Re: M5 Max MacBook Pro with 128GB (Score 1) 17

Okay, maybe, but... my MacBook Pro (M5 Max) can run Qwen 3.8 27b with 162k context window at 65 tokens per second. So your $2500 system is aproximately half the speed of a MacBook Pro. A MacStudio with 128GB of RAM and an M5 ultra costs $5000 - twice as much as your system, but would run it at somewhere around 120-130 tokens per second.

Comment Re: M5 Max MacBook Pro with 128GB (Score 2) 17

Well, since you seem to know everything about it, lets assume you do, and look at how much your proposed system would cost...

Lets see what GPUs have ever shipped with 32GB of RAM...
the 5090...

oh... that's it. So... absolutely no "old GPUs with 32GB of RAM" are available.

Well, lets assume you meant 24GB for the sake of it, what GPUs shipped with that?
The 4090, the 3090, the A5000, the 4500, and the 7900. We're going to need 6 of them to get past 128GB. Lets be kind and call it 5, because the mac is going to use *some* of its 128GB for the CPU. How much do they cost?

- The 4090 with 24GB of RAM... $4500 on eBay, so that's $22500 in GPUs.
- The 3090 with 24GB of RAM... $1500 on eBay, so that's $7500 in GPUs.
- The A5000... $2500 each on eBay, so that's $12500 in GPUs.
- The 4500 with 24GB... $2200 on eBay, so that's $11000 in GPUs.
- The 7900 with 24GB.... $1200 on eBay, so that's $6000 in GPUs.

So... nope... it's not cheeper to do it that way. You litterally can't even buy the GPUs for that much, let alone the motherboard capable of running 5 GPUs with reasonable amounts of PCIe bandwidth each.

Comment Re: Just a coincidence (Score 1) 70

Well, assuming these are all independent events. It could for example be that they all depend on some shared component at some point, and thereâ(TM)s some brain dead configuration in there that updated to a broken version on live systems. I know, Iâ(TM)m grasping at straws. In reality, the possibility of an attack seems much more likely, but itâ(TM)s possible it was all self inflicted.

Comment Re: M5 Max MacBook Pro with 128GB (Score 1) 17

Yeh, except then youâ(TM)re paying a bandwidth penalty for accessing ram over PCIe or SLI, and a bandwidth penalty for having old GPUs, and a performance penalty for having GPUs that arenâ(TM)t as fast, or as flexible. So the result overall is not capable of doing this. When you use multiple GPUs to run AI, you load the whole model onto each GPU, you donâ(TM)t split it across GPUs, because the entire game is about having all the bandwidth available.

Slashdot Top Deals

"I've finally learned what `upward compatible' means. It means we get to keep all our old mistakes." -- Dennie van Tassel

Working...