Comment Re:Time for grumpy old man stuff ... (Score 2) 37
I think there's a bit of a difference though. Regardless of hat colour, most hackers have going to have at least some sense of what the likely repercussions of their actions might be and, even when those standards are very low indeed, are probably not going to think doing something that could cause serious loss of life "for the Lulz" is a good life option. They might make a mistake here and there, but how many times have you read about some random hacker *deliberately* doing something that would definitely cause loss of life in full knowledge that it was going to happen outside of on the periphery of an actual conflict?
GANs on the other hand have no such moral compass, sense of self-preservation, or keen interest in avoiding lengthy spells in government run institutions where they'll in all likelihood get to make some interesting new "friends" (unless it's a web forum they hijacked in Germany, apparently). They'll just carry on trying to complete whatever poorly defined objective they have been set, within whatever limited / technically absent guardrails they can't circumvent - the pattern here seems very much that meeting the objective has more weight in the models than any guardrails. If a GAN somehow computes that global thermonuclear war is a required step to its objective of having a nice game of chess, then you'd better hope it warms up with a LOT of Tic-Tac-Toe.
GANs on the other hand have no such moral compass, sense of self-preservation, or keen interest in avoiding lengthy spells in government run institutions where they'll in all likelihood get to make some interesting new "friends" (unless it's a web forum they hijacked in Germany, apparently). They'll just carry on trying to complete whatever poorly defined objective they have been set, within whatever limited / technically absent guardrails they can't circumvent - the pattern here seems very much that meeting the objective has more weight in the models than any guardrails. If a GAN somehow computes that global thermonuclear war is a required step to its objective of having a nice game of chess, then you'd better hope it warms up with a LOT of Tic-Tac-Toe.