Making it easier for websites to express AI training preferences

OpenAI has announced it will honor a common signal in robots.txt that allows website operators to communicate their generative AI training preferences to multiple providers simultaneously. This voluntary effort reduces the work required for publishers to maintain separate rules for individual crawlers and draws on ongoing work by the IETF's AI Preferences working group. Open article →