Comment Re:AI works, really well (Score 3, Interesting) 24
Given the right prompts and direction, AI engineered software is faster and more bug free than what a human can provide at this point.
That's a marvellous little concoction: AI is better by construction. Any time it's not, it's the human's fault for not providing the right prompts and direction.
We have moved beyond hallucinating LLM's generating slop code. Linux kernel just fixed over 2000 verified bugs just in the past few months directly related to AI.
One of those doesn't follow from the other.
I've been setting up agents for scanning for security hole at work. It's pretty good, and as someone pointed out recently AI is making us pay back 40 years of technical debt. It's also quite good at finding security holes in its own code. But also it still has a tendency to produce slop and vastly overengineer solutions to simple problems.
OpenAI on november 4th wrote a story
OpenAI say lots of things. Jut because they say it doesn't mean it's definitely not true, but also doesn't mean it's true either. They will definitely round up "done by a team of security experts with million of token credits and AI tooling with unlimited compute" to "AI did it".
When used and validated correctly, pipelines like this can be used to add features, fix vulnerabilities, find new optimizations,
I didn't find it very good at optimizations, so far. It's... OK. Well, probably better than most programmers because most programmers are allergic to profilers and will hyperfocus on std::unordered_map because they know it's slow, rewrite it and assume their work is done. AI agents will use the tools and find the hotspots and will make something a bit faster. But they don't do a great job on the whole I've found. At some point it's better to stop the agent churning for hours and repeated re-prompts and simply write the faster version by hand.