Comment Re: They can only self-improve if they are capable (Score 1) 93
The interesting thing about the Terminator movies is that when AI researcher Miles Dyson became convinced that his work had a high probability of resulting in an artificial general intelligence attempting to replace humanity, he did not go and post a ten thousand word essay on LessWrong about how he had updated his timeline and p(doom) estimates and discussing the full Bayesian analysis of the situation. He went to the lab that very night with some heavily armed companions and he blew the place up.
I keep hearing that one AI researcher or another claims that they believe as Dyson came to believe. Until one of them takes similar action, I simply do not believe that they actually think their research carries such a risk.
You have access to the lab where the work is being done? You regularly meet in person with leading researchers and talents driving the project forward? You are an American and you have the Second Amendment? And the entire future light cone is at stake? Quintillions of hypothetical future lives riding on the outcome of this project here and now?
What's the most effective, altruistic thing you could do for them?
Yeah, exactly. I've never heard of anyone shooting up their AI lab. Which tells me they don't believe their AI is at all likely to wipe us all out.