I've had many moments where I used an LLM to make something from scratch, and have been extremely impressed in how good the implementation was and how much time I spared at the (likely still very underpriced, I am expecting a rugpull there) expense it cost me.
The issue is, you do this three, four times and get reasonably functioning implementations. Often ugly, but whatever. I have use for a lot of temporary tools that really serve to explore something in a mixed analysis-prototype kinda regimen, that makes even un-maintainable proof of concept kinda thing that I can hammer out in 15 minutes of writing the spec and waiting for an hour to get a whole working program.
The issue is, the fifth time, the thing shits the bed and misunderstands something fundamental and in such a an incredibly inhumanely weird way that it can poison a knowledge base with a completely wrong conclusion, and if you don't approach the LLM wit a borderline adversarial level of suspition and mistrust, you may never notice, and particularly enabled by the high speed of development you now have thanks to the elements, you end up with it deep in the foundation of your work, potentially poisoning days and days of effort that follow.
And while the overall code quality is improving and the whole thing gets faster, and cheaper, and like, median-decision smarter, the long tail of LLM-exclusive idiot moments persist, and the moment you wholly surrender the codebase to only ever touching it via the LLMs, they'll ruin your day more and more often as time goes on. And before you know it, you're using most of your newfound productivity to chase down these fuckin' quantfart landmines, just to eventually enjoy the ultimate infuriation of the LLM telling you that thing you just found really is an obvious error it should have noticed the first time, acting like it's all good.
Sometimes, I wonder how often LLMs bury a landmine that takes a company down. They made sure there's no accountability. You're always responsible for the code you didn't write. Nobody will ever be able to come after Anthropic with the damages a customer sued them for. So, what happens when nobody is reading the code? What happens when nobody is left in the company that *can* read the code? I think this will become an increasingly frequent issue.
I do concur there's utility to LLMs and I do expect to use them for the rest of my life. I suspect the difference between me and never-LLM-ers is that, I admit it, I never enjoyed coding in the first place. It's just one of those things where, for most of my life, it was the one skill I had any degree of knack on that put bread on the table with minimal effort required on my part. Now instead of coding and hating it, I have to wipe the drool off an LLM's chin, hating it. I don't think it's elevating me as a person. I'm not sure it elevates the projects I work on. I kinda don't care. I've never been passionate about programming. I've been passionate about being able to afford food and living space. Fuck coding, and fuck coding with LLMs.