Comment Re:Why doesn't this exist? (Score 1) 39
The first two did not exist but the last two do exist but had nothing to do with the topic cited. It would still take a human to determine that these cases where bogus citations.
If you gave an LLM access to a legal database, not training it on it but allowing it to pull things from it, then you should be able to use it to check citations. It should be able to handle both looking things up and reporting null results, and also summarizing those cases it does find and doing a better-than-nothing job of reporting whether they were cited correctly.
If I were a lawyer I wouldn't trust such a thing to check my citations, but I would absolutely use it to look for low-hanging fruit in my opponent's work.