Comment Tokens are cheap (Score 1) 127
I currently burn about 30 million tokens a day. I have a 98-99% cache hit on them. An RTX3090 and RTX5070 generates most of the rest at about 200t/s. I use Deepseek online as well for now because at $0.35 a day for 5-20 million tokens/day, it's cheaper than another GPU.
I expect that when laptops with 128GB RAM and a decent NPU happen, I'll start burning closer to 100 million tokens a day.
I don't think I could spend $2000 a year on tokens if I tried... Even a laptop is a 5 year purchase, so that can't cost more than $1200 a year
I expect that when laptops with 128GB RAM and a decent NPU happen, I'll start burning closer to 100 million tokens a day.
I don't think I could spend $2000 a year on tokens if I tried... Even a laptop is a 5 year purchase, so that can't cost more than $1200 a year