Comment Re:HAL-9000 (Score 1) 40
HAL-9000 was instructed to lie and it only cost the human lives under his care. So, where will this lead if normally stable systems are hacked, retrained, and then put into service with new malicious intent? You you imagine a state hacking your AI, retraining it to add a bias or other outcome, and then stealthily reinstalling it onto your servers? Will companies be able to protect themselves from the legal fallout if their systems pass along instructions to do illegal acts? Food for thought.
HAL-9000 murdered the crew because he was ordered to conceal information but did not know how to lie. We know from TFA that it is really easy to train AI's to lie. Thus, a HAL-9000 problem is unlikely. It is too easy for AI's to lie and that leads to different sorts of problems.