Comment They're Doomed (Score 1) 106
I've been using AI to write code recently. I figured I should give it a go.
Not reviewing and understanding and editing the output code is a recipe for disaster.
For example, in code for a cryptographic hash function there are padding rules to bring the data size to a multiple of the block size and add a length. So for example with SHA3, a minimum of 65 extra bits. If your data length mod the block size is 65 bits less than the block size, then add the pad bit, put the length at the end of the block and fill in between with zeroes.
If you are longer than that, then it all spills over into the next block and you add a block.
If your length exactly ends up fitting in the block size, then you add a whole extra block with just the padding bit and length and a bunch of zeroes.
The hash that claude spit out missed that last case, so creating a hard to find bug, where in one out of 512 bit sizes, the hash fails. If I had not spotted that by reviewing the code in detail, there would have been a catastrophic bug creating a security vulnerability and system failures in chips.
So read the code and fix it or be doomed.