Search
Cloudflare Unveils AI Bot Red and Black List; ByteDance Falls Short on Crawling Protocol Compliance
2 day ago /
Read about 0 minute
Author：小编
Cloudflare has introduced an AI Bot Red and Black List, initiating evaluations with OpenAI, Google, Meta, Anthropic, xAI, and ByteDance. This list assesses, identifies, and compiles data across four crucial dimensions: bot IP verification, WebBotAuth validation, bot segregation, and adherence to the robots.txt protocol. Currently, OpenAI's bot stands out with exceptional performance, whereas ByteDance, Anthropic, and xAI Grok bots occupy the lower ranks due to their near-absence of verification measures. The objective of this list is to empower website administrators in making informed decisions regarding the blocking of these bots.
-
C114 Communication Network -
Communication Home
7 X 24 Track global technological trends
