Comment Should get really exciting. (Score 2) 18
Obviously the switch from "loss leader on a scale the capital markets can barely absorb" to "losing money" is going to sting; but I'm curious if we'll see sneakier knock-on effects.
So long as they were losing money hand over fist the vendor does want to throw enough tokens at you to make you feel like you are having a good time; but as few as are required to do that since they lose money on every one. If they were breaking even or turning a profit the incentive would be to sneak as much spend and upsell in as possible; and it's well known that the verbosity/cost of LLM chatter is hard to predict; harder if there are multiple models and other complications being switched around in the background.
What sort of exciting little tricks will we see from vendors who actually make more if you use more?
So long as they were losing money hand over fist the vendor does want to throw enough tokens at you to make you feel like you are having a good time; but as few as are required to do that since they lose money on every one. If they were breaking even or turning a profit the incentive would be to sneak as much spend and upsell in as possible; and it's well known that the verbosity/cost of LLM chatter is hard to predict; harder if there are multiple models and other complications being switched around in the background.
What sort of exciting little tricks will we see from vendors who actually make more if you use more?