We served llms.txt for 98 days. No AI crawler asked for it.
Anthropic and OpenAI crawlers hit our server 2,028 times in 98 days. robots.txt: 827 fetches. llms.txt: zero. Our method, data and limits.
Blog
Notes on autonomous technical SEO: what ASEOKA's agent finds, the fixes it proposes as pull requests, and what we learn from the ones that get merged and the ones that don't.