Amodei and others are worried about what AI that doesn't yet exist may do, not about what current-generation AI can do. AI is getting better, very quickly, and unless there's some blocking obstacle that no one has been able to identify will at some point become far, far smarter than humans, individually or collectively. So before that happens, we need to figure out how to make sure that superintelligent AI wants to help us, and wants to do it in the right way.
AI already helps us to surveil masses of humans, automate judgement of humans, trick and spam humans, automate crimes against humans and ultimately render humans obsolete. A more powerful AI would only serve to assist in doing all of these things more effectively.
I have no reason to doubt authoritarian dictatorships and corporations the world over will perfect the art of making sure super-intelligent AI wants to help in all the right ways.
Years ago around ChatGPT 4 release there was this notion being peddled the AI firms would have to be extra careful to vigilantly guard against escape of super intelligent AI. What was funny about this at the same time we all had a front row seat to OpenAI corrupting itself from within not due to the influence of some advanced superintelligence but merely the simple greed of a self absorbed sociopath.
What Amodei and others are worried about is the pending IPO.