Comment Re: My daily dose of confirmation Bias (Score 1) 101
I'm glad you recognize the confirmation bias, yet I would dispute that it is in any way vindicated. AI did not order the interception, put the assets in the air, or even submit the report. It got a manifest wrong in a chat session (not clear even it was its own error or related to the input), and that is... actually well-within common human error, not some special AI thing.
This doesn't contradict the OP's point in any way. The fact that AI came up with something that doesn't correspont to reality is not the point, it is well known that AI does that. That's not the concerning thing here. The fact that the US military was prepared to take a hostile military action because it believed an AI hallucination is the concerning thing here. When you're making decisions that can literally cost a lot of people their lives, you cannot include a so-called 'intelligence' that doesn't understand anything it's saying in the decision making process. And maybe there was no chance of an actual war but boarding other nation's ships for absolutely no reason can damage diplomatic relations, not just with China but with any other nation that has ships in the region that could potentially be boarded on such an unreasonable basis. Assuming this is something the current administration wants to avoid.
In fact intelligence is wrong all the time, and at all scales, but to name a big one, was AI to blame for the confidence of the existence of WMDs that was the basis for the Iraq war? Maybe it would have *averted* that war by helping with better assessment.
Given that it was certainly an excuse for rather than a reason for that war, no, it wouldn't, but that has nothing to do with AI.
And it's not even clear to me that anything wrong was done. They double checked the intelligence, found it was incorrect, and ultimately took no action. Isn't that... exactly what is supposed to happen?
That's one (and the most charitable) interpretation of what happened. It may have all been a part of the process, or someone may have intervened at the last minute to stop this.
Deploying your interdiction parallel to the intelligence check is a reasonable way to ensure a successful timeline in case something does need to be done. It's easy to recall planes in a false positive, not so easy to teleport them where they need to be for a verified true positive
As in, we're not sure if this building really has terrorists/enemy combatants in it, but let's bomb it a bit anyway and then later we'll figure out if the intelligence was good? That would explain some past incidents. Even in this case, what if they started the interception/boarding before getting the confirmation? What if they weren't even waiting for confirmation and were preparing to board before the abort order came through? And you might say, they're the US military, they wouldn't fuck up like that. Given that they're using ChatGPT in making military decisions, the kind of thing that gets lawyers held in contempt of court, I'm not so sure. If you're making decisions based on something as untrustworthy as AI, which you know may well have made the whole thing up, then one, you absolutely shouldn't do that, but two, you should at the very least always double-check before taking any action.