find it weird how basics are skipped when building products like this...
Logic would say if you're trying to automate a process... you first learn the process that you're trying to replicate and improve on.
The current process for target packages checks the age and accurancy of the intel that is being used.
THAT IS WHY THE INTEL GUYS THOUGHT IT WOULD FLAG OLD AS SHIT AND WORTHLESS INTEL. not- "no idea why they would think that". They would have assumed that because it's a basic element of building target packages. To not do it is stupid.. and this was supposed to be INTELLIGENT. It was supposed to automate the work they did manually, so the safe assumption is that it would do thesame work/steps/checks/validations/etc that would be involved in a human centered process... the established SOP. Why an AI would not follow the prescribed SOP that was written over decades in blood is again- idiotic. It's pure hubris that a tech company could improve on it in the dark with no experience.
Palantir saying oops- it was supposed to have accurate data... and Pentagon saying Oops... it was supposed to be smarter- both are incompetent idiots that didn't build the damn thing correctly from day one, both had assumptions based on nothing, and both didn't do propper testing before rolling it out for life and death decissions.... one would think the first while this system is used, that there would be a human vetting process that checked EVERY aspect to ensure the system was working correctly and to build confidence in it... find issues... correct issues. Not build first, trust first, verify never, test never/badly, and only find out how it works and why it f'd up when 150 civilians die.
Don't think they quite get the scope of this f'up. Asside from the loss of lives... The US had a position on the world stage where they could say they take every reasonable measure to prevent civilian deaths and colalteral damage... this thing completely erased decedes of actual effort on the part of the US millitary to build that reputation... a reputation and goal that has cost actual US service member lives.
And now it's an "oopsie"... a war crime is not an "oopsie"... a war crime is still a crime if the cause is incomptence.
Both parties are irresponsible idiots. Unfortunately, they're also rolling out Ai solutions in a similar fashion to most of the industry and corporate out there.
Lesson from all this - when rolling out AI, treat it like a new employee. Train it, test it, validate it, increase it's scope of impact/reponsibility over time as confidance builds.