Google, Microsoft, OpenAI, and Anthropic have endorsed a new AI training preference statement that lets websites signal whether their content may be used to train AI models by modifying their robots.txt file. Under the draft, site administrators need only add a set of rules to communicate their preferences to multiple AI companies that support the standard.
