Author adds llms.txt and llms-full.txt for agents
To make websites more accessible to AI coding agents and text scrapers, developers can add plain text doors such as an llms.txt map, an llms-full.txt catalog, and clean markdown copies of individual posts. The author explains that generating these files at build time reduces context window overhead compared to parsing heavy HTML pages. Although major search crawlers currently ignore these files, they offer a practical way to serve lightweight, structured content to automated tools. Open article →