Comment This is an interesting topic, at least to me. (Score 1) 2
I have been stress-testing AIs with increasingly complex projects for some time. The Chinese AIs struggle, but actually do a FAR better job of handling massively complex tasks than Grok, and Gemini just rolls over and whimpers at anything above a very low level of complexity.
What I've found is that the Chinese AIs tend to be sycophant but do "understand" complex projects properly in that you can ask specific technical questions and the answers will be generally very accurate. Any sort of critical analysis is beyond them, though. (Ether that, or I'm a mega-genius. Which....doesn't sound terribly likely.)
Of the "Top AIs", ChatGPT is good on basics but is incapable of any kind of detailed generation. Claude is brilliant at detailed generation, but overloads with anything but a tiny data set.
I've been putting up the projects on Gitlab for a while, so anyone who wants to see an AI break down and cry in despair is able to do so.
The secret tools don't bother me - they'll have long understood how to use Big Data and Analysis of Competing Hypotheses. AI isn't going to find out any more than combinations of those tools will, because that's basically all AI is - a Big Data classification system.