Comment Outsourced Junior Developer (Score 1) 248
Like the title says, its effectively an outsourced junior dev. It has no experience of its own and is just parroting what it read, imperfectly. Plus you probably aren't generating any institutional knowledge.
Source code + compiler =reliable output , prompts + LLM-du-jour = inconsistency. Vibe-coding is going to leave a lot of people with zero actual knowledge of their product as if they had out-sourced the development.
Because that's what they did.
So with that out of the way...its really good at first-draft code documentation because LLM transformers were developed as translators and code->english is a translation. Not perfect but a good first draft.
Ironically, if you aren't going to edit that documentation out of draft, you are better off NOT having it create anything today and instead wait until the minute you need documentation and create it on-demand with a newer and more competent model. If all you get is a rough draft, get the best draft possible.
Its also useful as an initial code reviewer, much like the grammer checker in word is a good first reviewer of a document. Comparing the auto-generated symmary of a pull request to the original feature request is a low-effort way to confirm your work seems to meet requirements.
Along that vein it is also a good "rubber duck", a thing a coder will "talk" to as they work out a bug. Normal rubber ducks don't answer back but the act of stating the scenario is often all a coder needs to contextualize the problem to develop a solution. LLMs go the next step and can ask questions back.
I am told it is good for generating test cases. Test cases are generally not an issue for me but I'm assuming that's a peculiarity of my job.
As a coder it is wrong so many times. It is also prone to mixing styles/approaches between prompts, which makes it harder to read. Similarly as super-autocomplete I have had it give me functions from other languages and/or hallucinate the function completely. Its a bad search engine for the same reasons. Even AI ostensibly trained on a vendors docs is wrong often enough that I find it more irritating than reading the docs myself.
Will I use it to search or suggest code after my Google-fu has failed? Sure, but thats because I'm reaching for straws.