Cloudflare introduces a new pay per crawl feature allowing website operators to charge AI developers for content access.
Website operators define a fee for AI bots accessing their content; Cloudflare aims to prevent unauthorized data scraping and hacking attempts.
Cloudflare uses public key cryptography to verify AI crawler requests and block malicious activity within the pay per crawl feature.
Apart from this new feature, Cloudflare also introduced additional AI-focused capabilities like default blocking of AI crawlers and selective blocking of crawlers from pages with ads.