The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible — but I hear the same people express fear privately."
Extraordinary claims require extraordinary evidence. "AI will extinctify the human species" is an extraordinary claim, but it's also entirely borrowed from cheesy sci-fi movies, and citing Terminator is apparently this guy's only evidence.
How will AI kill us all, exactly? In addition to the question of, mechanically, how does it obtain the physical capability and resources and organize them to that purpose, I want to know how it does it without any humans noticing or intervening? (not only that it would presumably have to go up against other AGI or near-AGI competitors - the solitary AI made by a random unwitting engineer from the movies is obviously not how the present has played out).
Let's say it is going to build killer robots to off us all. Where does it get the raw materials? How does it setup manufacturing? Make the purchase orders? Do the humans just voluntarily send it massive amounts of ore and build factories in their backyards? Or does it have to mine its own ore and they don't notice the huge stripmines? Does it get the robots right on the first iteration or do they start off as a typical MVP in which case again no one notices? What about the energy bills? How does it navigate the required in-person meeting with the city to sign off on the parking lot tree choices for its downtown killer-robot-factory?
There are so many friction points and assumptions of actual humans interacting with each other to get anything done that "skynet on your laptop" would be about as helpless today as if it had appeared 50 years ago. And unlike the movies it doesn't "just appear."
Could we over the coming years remove a lot of those frictions? Sure. But we could just not, and if we are concerned about them disappearing, then surely we want to see where AI leads *now* and if it has a dangerous temperament rather than *after* we've automated enough for it to manage our resources fully independently?
Being conscious of new threats posed by agentic actors is reasonable and can be grounded in reality. But people who want to feel important have been waving "END OF THE WORLD" signs on streetcorners forever.