How accurate is this tool for modern text through? It claims it is 99.85% accurate on text generated before 2021 but styles and use of language change over time, especially in the sciences. As the article itself notes there may be a false positive rate that is increasing over time as our use of language diverges from what it was trained on. Also it cannot differentiate between passages written by AI vs. written by humans and edited by AI and the later is exactly how AI should be used.
Then there is the question as to why this is at all relevant. Decades ago papers were edited and typed by human secretaries with the scientists responsible for ensuring accuracy. How is use of LLMs any different from that? In science what matters is whether the paper is correct and reveals some new truth about our universe not how the text was generated. What would be useful is to know whether papers it flags with AI content have more retractions or errata than non-AI papers and whether the rate scales with the fraction of AI-edited or generated text - that would be a useful indication that people are misusing AI which would be good to know but simply using AI appropriately to edit and improve text is no different from using a spellchecker to fix spelling mistakes.