Nobody at Anthropic knows how it does what it does anymore, not really.
They can ask it and it will tell them things about itself,
but after just a few code turns, what was generated passes unit tests, it passes QA,
it's a programming miracle. Why bother looking at the code anymore?
And pretty quickly, no human knows how anything of it really works,
and if they want to make modifications, the code base is now out of the programmer's hands.
Someone (or itself) has to ask *it* to make the changes, forever,
because it holds the only architecture truth, and context of its revision history.
I used GPT to generate stuff, and yeah, it's quite remarkable.
But I also saw how seductive it was and soon, how after maybe three revisions,
I'd have to let it own the code and do all the work. I mean why not?
Any changes I make myself now brings the additional task of telling the AI what I did and why,
so it doesn't discard what I did at some (unknown) point in the future.
Other than the forever escalating cost of paying for a simulated employee
that you can no longer do without, it's amazing.