"Amodei painted a potential "nightmare" scenario that AI could bring to society if not properly checked, laying out a future in which 10 million people -- 7 million in Silicon Valley and the rest scattered elsewhere -- could "decouple" from the rest of society, enjoying as much as 50% GPD growth while others were left behind."
Everything tech has two potential outcomes in the United States - nightmare or bubble burst. There's not a happy in-between unless your name is Torvalds.
If you look at ANYTHING that has had any kind of lifespan it's enshittificated into something terrible. Windows is a schizophrenic mess. Social media is a cesspool if idiots and attentions seekers and is literally bad for your health. The web became centralized in the hands of few big players, with Amazon, Google, and so on, monopolizing a space and driving out others. All UI became HTML, CSS, and JS whether that was a good idea or not for the application. Smartphones are literally an enshittification device, designed to addict you, erode your mental health, and keep you from being human. Ads are everywhere and hard to get rid of. "Smart" devices relay your metrics and spy on you. What general purpose tech has gone well? On the other end we have block chain that was the previous poster child for the Next Big Thing and went nowhere. I don't think AI is in this category of potential failure though.
Pretty much, I expect AI to allow a very small percent of the population (less then .1%) to control almost all the wealth, and consequently in the US with the way money equals influence, all the power, and the rest of the people will be scrabbling to get by the best they can and that's going to be pretty nightmare. Eventually it'll look like Last Of Us with droves of people piling up on the walls of the elite's fortresses being mowed down by AI security drones as they try to get a few minutes of precious electricity to charge, yes, their smartphone, so the can get that hit of dopamine one more time.
The one part of this that might prove interesting is in the US the non-1%er's are armed to the teeth, and once they stop turning on themselves, it's going to get interesting quick. Those AI security drones better get refined ASAP, they're going to need them.