Comment: Re:This sort of thing is an important step (Score 1) 392
That said any AI we build is going to be stupid for a long long time. No instincts. We have hundreds of millions of years of lizard brain fear. Fundamentals a true AI will lack. These biases don't always serve us well but they tend to highlight core priorities that an AI would not have... remember... an AI won't have any notion of self preservation. That is a genetic quality. We preserve ourselves because those that don't don't reproduce. An AI has no such instinct. No instinct to power. No notion of anything. Blank slate.
AI's don't scare me. Even an AI will probably just do what we tell it to do... why would it do otherwise. And what use would it be if it disobeyed.
The factors that condition its survival will be its utility to us. AIs that don't make themselves of use will not exist for long.