Comment Local LMs worth it? (Score 1) 40
For about $3000 USD you can buy an AMD Ryzen AI 395 with 128 GB of integrated RAM, which I'm tempted to do to run coding models. Although it seems to me that 256 GB is more of the sweet spot for local LLMs that can do things at a decent speed. For that size of RAM, the only real game in town is the Mac Studio, will cost about $10k (and rising). Of course even $10k is cheaper than a personal assistant. Now with the true cost of agentic AI starting to fall on the customer, $10k doesn't seem so ridiculous.