Comment Distributed responsibility and transparency (Score 4, Interesting) 227
This is an example of one of the legitimate challenges facing the increased integration of AI into warfare.
The more fundamental problem is distributed responsibility and lack of transparency.
Until recently, drone strikes required a long sequence of command decisions, starting with intel gathering, analysis, decision, orders, and remote command of the device. No one is directly responsible when something goes wrong, the failure is distributed among many players with the result that no one has to bear the consequences.
For example, the "collateral murder" incident, where apache helicopters gunned down civilians and journalists.
In normal situations, we have Derek Chauvin, who was an individual who caused the death of one man. He went to trial, the evidence was examined, and guilt was assigned. Trials are more-or-less held in the public light, and journalists and interested parties can examine court records and in some cases reanalyze evidence (not all physical evidence is kept or available, but for example, DNA evidence can sometimes be reexamined).
That's how it's supposed to happen.
Contrast that with erroneously ordered drone strikes that hit civilians instead of legitimate targets.
I suppose the biggest, most egregious example would be George Bush taking the country to war because Saddam Hussein had "weapons of mass destruction", and of course one were found, and the security services swore up and down that they told him there were none, but he stated "well, the message didn't get through".
And skated responsibility. Completely.
To bring this closer to home, software engineers implement all sorts of insecure, inconvenient, and privacy violating features with no moral pushback. Even if it's completely obvious that something is an anti-feature, people do it because a) their job depends on it, and b) it's someone else's decision. And if there's a breech and ten million social security numbers get made public, the company simply fixes the problem and continues. No responsibility is assigned.
I was satisfied to see videos of the "narco terrorist" boats get destroyed, and then the survivors killed. Not the actual killing, but just knowing that the event was recorded and analyzed in the public sphere, and there was a conversation about it, and it was investigated. That seems like it was handled the right way.
Death is permanent, it can't be undone. If we're going to kill people, regardless of whether it's AI or anything else, it should be transparent and put into the public discourse.
No one is assigned blame for screwing up, that's the more fundamental problem.