I read the headline. Was excited.
a second later saw it was an "electrek.co" link and my heart sank.
Clicked through anyway... and sadly confirmed that it is a kernel of truth, but wrapped in misleading exaggeration. It's propaganda and boosterism rather than a concise and informative take. And this happens basically for every /. story from them.
e.g. i look forward to this summer's inevitable series about the records for how many hundreds of days California has run on 100% solar energy....
i forget exactly the phrasing, but it's the same technically true, but it doesn't mean what they claim it means thing every time.
basically it is not "p-hacking" it's "importance hacking":
Importance Hack - get a result that is actually not interesting, not important, and not valuable, but write about it in such a way that reviewers are convinced it is interesting, important, and/or valuable so that it gets published. In other words, Importance Hacking means taking a result that competent peer reviewers would not be likely to view as worthy of publication, and telling a story about those results that causes those reviewers to misperceive it as being worthy of publication. Unlike p-hacked results, importance hacked results do replicate. If you re-did the same study on a similar population, you would be very likely to get the same results as the original study. But the results don't have the meaning or importance that they were claimed to have.
from https://www.clearerthinking.or...
i got this concept from the "Clearer Thinking with Spencer Greenberg" podcast where it comes up every once in a while. He's some math PhD dude who some years ago started running replication studies in Psychology. He's some sort of mover in the Rationality space... i should look up his full bio because i've only inferred his path so far. In any case, the podcast is not about the replication stuff per se, just interviews with various people about data / thinking / psychology stuff.
Often a good podcast https://podcast.clearerthinkin... i wish he was somewhat tougher on his guests, but still generally gets them to fair presentation of their views, for better or worse.