OpenAI Google Microsoft Anthropic honor robots.txt policy token

OpenAI, Google, Microsoft, and Anthropic have agreed to support a common policy token allowing websites to opt out of AI training via robots.txt entries. The author argues this move is largely meaningless because these companies have already scraped the internet for years without permission or compensation, making the opt-out an ineffective measure after the data has already been taken. Open article →