AI startups drive bulk scraping that overloads websites
The author explores why a new wave of AI scrapers is disproportionately hammering free-to-use websites and APIs, unlike polite legacy search engine bots. The article argues that well-funded AI start-ups racing to build proprietary models are buying bulk training data from third-party scrapers who are incentivized by volume and speed rather than civil behavior. Furthermore, the author suggests that proposed legislative bills aimed at penalizing hidden scraping will likely fail to stop bad actors while harming open internet access. Open article →