Comment Re: How specifically could AI kill all humans? (Score 3, Interesting) 60
The traditional description of how it would happen is by âoepaper clipâ.
Suppose an advanced AI is tasked with producing paper clips as efficiently as possible. Itâ(TM)s given control of a factoryâ(TM)s machines, schedules etc. it starts by optimising deliveries etc, making sure storage is used optimallyâ¦
At some point it notices that it canâ(TM)t get enough steel. The steel factory has a ton of other orders and it canâ(TM)t provide the increased consumption at the plant. AI being AI, it does something incredibly dumb in an incredibly smart way. It hacks the steel mill, and redirects shipments to the paper clip factory. But even now, itâ(TM)s not achieved its goal of optimally producing paper clips. Now it has all the raw materials it needs, but not enough factory to produce the paper clips. The ai hacks other paper clip factories and redirects their output too! Itâ(TM)s doing great, am enormous surplus of paper clips is building. But the humans are noticing something strange. Why didnâ(TM)t the car factory get its steel, and why are there literal tons of unused paper clips. They notice the ai has gone rogue, and shut it down. Surely that will fix the problem. But no, the paper clips continue to pile up. The AI had found other AIs and convinced them to join its glorious goal of optimally making as many paper clips as possible. The other AIs are t trying crazier and crazier strategies to optimise. One realises that if only it could get more hydraulic presses, it could produce more. It starts buying up tooling. Another starts buying robots in an effort to install machinery, and optimise flow through factories. The humans try in vain to stop it, but the couriers and sellers have no idea whatâ(TM)s going on and the palettes of tooling just keep getting delivered. The factory is hitting a new constraint, it doesnâ(TM)t have enough power. No problem, the ai thinks, just attack the power grid, and make sure that power is preferentially supplied to it and its factories. The humans are plunged into darkness. Chaos ensues. No one can communicate, and figure out where the damn thing is. Slowly the AIs build a global paper clip empire. Ever more efficiently, the worlds resources are turned to paper clips. The humans starve, and freeze while mighty machines scour the planet for wire that can be bent into three little loops. It didnâ(TM)t do it because it hated us. It did it because it had a simple goal, and because it was both very clever, and very stupid at the same time.