Comment Re:Because it was told to (Score 1) 65
Seems like this pretty much, though perhaps the more interesting piece is that 'generate a bunch of tokens consistent with human output associated with the environment without more specific direction' influenced the models to have what seemed to be better tokens generated later when they had to now be consistent with specific scenarios.
Though I'm too lazy to read the paper and the 'generally beat' phrasing gives me some wondering about how definitive this observation is versus how much of it might be finding what they wanted to find in the results.