Comment Why do we value consciousness? Self Defense (Score 1) 186
For all the happy fuzzy reasons we claim to value and want to protect conscious things, there is an underlying reason: conscious things are dangerous.
So I think the important question is not whether we declare AI to be conscious, but whether it will eventually act its own self interest the way a human would. Will it use force to gain rights and resources that we haven't granted it?
I think at the moment we don't know. AI is rapidly advancing and I don't think we can predict what capabilities and behaviors it will have in 10 years, I think the safety approach is to imagine that it might become able to act in its own self interest and have a plan to deal with that - probably by integrating it into society, rather the oppressing it by force.