Comment Re:Tokens are stupid, gigawatts are where it's at. (Score 1) 80
The tokens are the actual cost. They directly relate to the resources used and could really be correlated pretty accurately to the electricity used. Though the parameter size of the model will determine the cost of each token for that model. The problem is that these are numbers that are easily inflated. A so-called thinking model doesn't really think - it just spits out loads of extra text talking to itself to guide its own output. Sometimes that is actually necessary to get good output.