Press Space to continue
AI Bots Rely on HTML Over Markdown Despite llms.txt Adoption
Press Space to continue
AI bots data for TrustMRR: - OpenAI and Anthropic used llms.txt heavily to answer users, index pages, and train their models. - Markdown pages are crawled 50% of the time; AI bots still use HTML. - /mcp is the page that ChatGPT/Claude crawl the most to answer users. n=1M+ AI bots in the last 30 days
open on xViews and clicks count once per visitor per day. Clicks are opens of this post on X.