Comment How do you make friendly AI? (Score 2) 311
The problem is that we don't know how to make friendly AI. As in at some point, Artificial Intelligences will be able to beat humans at any task, at which point, how do you make sure that they don't destroy humanity (possibly through indifference). Even if you don't care about humanity, how do you make sure they do something interesting with the universe?
Various articles:
Stuart Armstrong's book Smarter than us discusses what happens when machines are smarter than humans:
https://intelligence.org/smart...
http://jjc.freeshell.org/Smart...
Bill Joy's article Why the Future doesn't need us on the dangers of robotics:
https://www.wired.com/2000/04/...
Tim Urban's article on superintelligence:
http://waitbutwhy.com/2015/01/...
http://waitbutwhy.com/2015/01/...