If you pay for tokens from any cloud-AI provider or pay for power to run your own LLM(s) with this new software...I don't see that much difference to be frank.
In both cases I lose money and in both cases I have to hope that financial loss produced results that makes me more money than I spent.
Local is more Private and I happen to have a large roof...well, more than one, completely filled with solar panels. And I live in a place with a lot of sun-hours, so on sunny days I really don't feel that much of a financial burden running my own LLM cluster. And there is still room left on anther location on my terrain, where I could place quite some more panels. Those cloud-tokens may be faster and perhaps even of better quality, but me spending on those is relentless. And I will always have questions about privacy with them.
Nah, I like LLM solution where I am more in control of. And to be honest, the Qwen 3.8 LLM (27b) I can run locally, generates decent quality tokens. Having a few of those instances managed by a piece of software NVidia is now offering...in a location where I have much more control regarding energy-safety and privacy, sacrificing speed and a little quality, it really doesn't sound all that bad to me.
I recently saw a company's bill for API access to cloud-AI (routed over Claude, Codex, Gemini and Grok) with some 10 very active AI users for a single month that ended up to be almost 18.000 Euro, close to 20.000 USD in freedom money. Who knows how much that company spends in a single year on AI. Even that monthly bill would already give me enough for all the panels I would need. Another similar month would pay for quite some GPU upgrades, even with the excessively inflated hardware prices of today. A 3rd month like that and I would have enough money to pay my yearly energy bill while running my local AI cluster full tilt for 24/7. The rest of the year...gravy/profit?!?
Cloud-AI, especially from OpenAI and Anthropic, is expensive. But with their totally unsustainable token pricing from today and in the past, it is worth it. However, if either OpenAI or Anthropic has to become financially sustainable, let alone profitable, their current pricing is simply far too low. A tenfold in token-price would do it, but at that point a local LLM cluster becomes financially far more interesting and not without too much loss in token quality. Especially if you start with such a cluster now and give it opportunity to apply reinforcement learning on itself for your specific use-cases and workloads.
A far more sustainable AI/LLM future, if you would ask me. And yes, I am aware you didn't.