Submission + - Cloudflare Begins "Pay Per Crawl" (businessinsider.com) 1
The moves address concerns about Big Tech exploiting content without consent or payment--a shift that could reshape the dynamics between content creators and AI companies. The company will automatically block AI crawlers from scraping the websites it powers, unless site owners explicitly opt in.
"Original content is what makes the internet one of the greatest inventions in the last century, and we have to come together to protect it," Cloudflare CEO Matthew Prince said.
Cloudflare hopes to create a transparent, consent-driven marketplace that helps creators decide whether to allow all AI crawlers, permit specific ones, or set their own access fees, turning previously unmonetized content usage into new revenue streams.