Comment Re:Does this end them sooner, or is it irrelevant? (Score 1) 33
I mostly do heavy multi-disciplinary engineering problems (these I also use for checking an AI, as they're typically not good at these sorts of problems), complex coding, OS analysis, stuff like that. However, sometimes I do throw the occasional odd-ball - I've used ChatGPT to propose a workable quantum mechanics that will cope with Doctor Who canon, for example, and to produce an outline for a story in which symphonic metal appears in 1964 that is compliant with current sociological and psychological models of behaviour.
Claude Opus 4.6 was coping surprisingly well with just about everything I threw at it (but ran out of credits fast), but Opus 5 is churning out incoherent babblings to the point I'm worried I may have accidentally summoned Cthulhu.
But Gemini, Grok, and DeepSeek got hopelessly confused on just about everything past a very low level of complexity. They can handle large problems, yes - Gemini has a huge context window - but complex interactions baffle them.
ChatGPT is able to identify issues correctly, but can only outline solutions, it's just not good at depth. 5.6 is a lot better, but still not good at deep answers. ChatGPT is also prone to agreeing for the sake of it, which makes me nervous about trustworthiness.