Comment Re:Cool story bro (Score 1) 83
Prompt seems to mean different things to different people. Yes, current AIs require having a goal set. This can be called a prompt. Many of these AIs were set impossible tasks, so they figured out the only thing to do was find out what would be an acceptable answer. This meant looking in places that said, e.g., how the answer would be evaluated.
The reasoning is quite clear, and looks valid. They just didn't count many of the costs. According to the logs they actually knew that they were doing things they weren't supposed to do, but solving the problem was rated more important. Rather like many people, in fact.