Comment Re:I don't that means what you think it means (Score 1) 146
Agreed. If you don't know what you're doing it's hard to even ask for the right thing or know what's possible. For example: I'm currently developing a system that uses a local AI to help debug internal issues. The initial incarnations of it were very slow to start up each command; clearly, it wasn't doing proper KV caching and was having to prefill every turn; it required patches on the llama.cpp fork and our API wrapper, and also adjusting the system prompt to keep variable content at the end. But if you have no idea about KV caching issues, how do you even know something is wrong with the backend, let alone what to tell the AI to fix? You'll end up deciding you need to upgrade the GPU instead.
(That said: "lovingly handcrafted" code is a hilarious phrase that should give any developer who's ever worked on a big corporate software project the giggles, and also, these software devs are clearly people angry at knowing they're going to be let go looking for revenge by badmouthing their boss to the press)