Cloudflare has introduced Pay Per Crawl, a system that allows publishers to charge AI crawlers for accessing their content.
This initiative offers publishers the option to control access to their content and monetize it through a Payment Required status code.
Pay Per Crawl uses cryptographic authentication and structured pricing headers to enable secure payment-based content access.
The system addresses concerns of publishers regarding fair compensation for AI scraping and aims to create a scalable alternative for monetizing digital assets.