Comment Re: They can only self-improve if they are capable (Score 1) 215
Dyson was lucky he came to this realization in the 90s -- he only had 1 building and 1 relic to blow up. How do you blow up all the data centers of all the frontier AI companies unless you are the US Air Force or NSA and prepared for enormous civilian (including US citizen) casualtites?
Realistically, even USAF can't do it since they don't want to trigger global thermonuclear war, which is why you're left with needing an international agreement between the US and China (at the very least) to materially manage AI risks.