Comment Re:Intelligence must be controlled (Score 1) 74
your not going to get universal values or universal common sense because frankly there's no such thing.
There is, but it's at such a low intuitive level it's extremely difficult to notice without having something else to compare. Here's a universal common sensical value: "no social grouping is predicated upon the unrestricted right of any member to murder any other member for any reason whatsoever". It derives from natural selection: any human social grouping that at some point had developed that as a value went extinct once everyone murdered everyone else, so only those that held alternative values (that it's okay for some members to murder some other members, and for members to murder non-members, under defined criteria) survived, making this a general shared value -- though, evidently, the criteria for when murdering others is and isn't socially acceptable (and must be celebrated or severely punished) vary wildly.
The interesting thing is precisely in that machines may lack human values even at that low level, and it takes a lot of effort to imagine all the ways they can end up doing things that violate these baselines so utterly obvious to us we take them for granted and never ever even state them explicitly, so self-evidently obvious they are to us.