Comment Interesting but too late... (Score 1) 25
Had this existed three years ago, it might've been interesting.
That said, there's something missing. There's two ways a crawler can work. Either they request content, get told a price and have to reconnect and agree to the price OR they can declare in advance what they're willing to pay and just get approved if you're not asking for more. What's missing is the "soak these bastards for whatever they're willing to pay." If I've set my price to $1 and they connect up declaring "I'm willing to pay up to $3", I just don't get that $2 difference. That tells you whose side Cloudflare is on. And this all assumes AI scrapers manage to don't manage to disguise themselves as something else.