Search
Cloudflare’s Updated Policy Calls on AI Firms to Compensate Publishers for Content and Differentiate Between Search and Training Crawlers
19 hour ago /
Read about 0 minute
Author：小编
Cloudflare has announced that, effective September 15, 2026, it will implement notable changes to the default settings for websites leveraging its services, introducing new regulations for the AI sector. Specifically, AI companies will be required to clearly differentiate between web crawlers employed for conventional search purposes and those utilized for AI agent and model training. Failure to do so will result in the automatic blocking of these “mixed-use” crawlers across a significant portion of ad-supported pages. The new policy will primarily apply to newly registered domain names, new sites from existing clients, and current users of the free tier, with paid subscribers remaining unaffected.
-
C114 Communication Network -
Communication Home
7 X 24 Track global technological trends
