Comment Re:Holy shit, the logic fail here. (Score 5, Interesting) 38
There's a much deeper potential Ethical Holly Shit here, this is a big can of worms being opened. That of synthetic (read "made up") with unverifiable claims to credibility, through AI and a real data set.
The reason medical data is needed in research is to _verify_ the effectiveness of treatments, drugs, or patterns that are later ultimately used to justify treatment plans or decisions about what medicines to legalize, prescribe and use.
Feeding real data to AI and then asking it to "make up a data set that's the same" breaks the link between real hard data collected by physicians and clinicians, which is _verifiable_ and _trustable_. There is no way aside from repeating the work with real data sets to verify that the data in the "synthetic data" set is representative of the real world.
If this synthetic data set is used to make decisions, there will be a significant risk that can be introduced in the AI process, as 1) there is no verification possible and 2) the potential to "ask AI" to "help clean up the data" raises potentials for either open abuse, or accidental skewing of the data. Even non malicious but hopeful AI prompts may cause the AI to deliver the results the researcher or pharmaceutical company "wants to find".
That could lead to incorrect results or desired or not which would lead to bad decisions about patient treatment or diagnosis potentially leading to wasted money at best and patient harm at worst.
Ethically, I think this is standing unroped on a slippery slope uphill of a cliff...