Demand Media model content could poison chatbots
The author argues that the content-farming business model used by Demand Media in the late 2000s to game Google search rankings would be even more damaging if applied to large language model training and retrieval pipelines today. While search engines eventually suppressed low-quality SEO farms, automated generation tools make producing volume cheaper, and vector retrieval systems reward the exact query-matched phrasing that content farms generate. The author contends that unlike searchable indexes, trained models cannot easily re-rank or remove poisoned data once it enters their weights. Open article →