mintlify/agent-traffic: Tell agents, AI crawlers, search crawlers and bots apart from people
Mintlify has open-sourced agent-traffic, a dataset and classification package designed to help developers distinguish between human users, AI agents, search crawlers, and bots. The library verifies crawlers against published IP ranges, checks headers, and can be used in Cloudflare Workers, Node, Bun, and other JavaScript runtimes. Open article →