[ Answers · AI search ]

Does llms.txt work?

By Ben Tabas, Intrica Research · Updated

Answer

Almost no one reads llms.txt files. Ahrefs' study of 137,000 sites, published June 15, 2026, found 97% of llms.txt files received zero traffic in May 2026. Google's AI features guide, updated Dec. 10, 2025, says "You don't need to create new machine readable files, AI text files, or markup to appear in these features."

What the data shows

  • Ahrefs analyzed 137,000 domains that all received traffic in May 2026. Its article, published June 15, 2026, reports that 97% of their llms.txt files received zero traffic that month.
  • Among the files that did receive requests, Ahrefs reports that 19.5% of fetches came from named AI tools. That share counts requests, not files.
  • Google's guide, updated Dec. 10, 2025, covers AI Overviews and AI Mode. It does not name llms.txt, and its statement about AI text files applies to those two features only.

What to do instead

  1. Allow the search crawlers. OpenAI's crawler page, checked Oct. 29, 2026, says sites opted out of OAI-SearchBot will not be shown in ChatGPT search answers.
  2. Check that your CDN and firewall let those crawlers reach your pages.
  3. Put the facts buyers ask about in plain text on the page itself, with the answer in the first two sentences.
  4. Treat an llms.txt file as optional. Neither source above shows it changes what an engine cites.

See which AI crawlers your robots.txt and firewall block today, which matters more than an llms.txt file.

Run the free AI Crawler CheckBook a call

Sources

  1. We Analyzed 137K Sites: 97% of llms.txt Files Never Get Read · Ahrefs, June 15, 2026Supports: 137,000 domains, 97% of llms.txt files with zero traffic in May 2026, and 19.5% of fetches from named AI tools.
  2. AI features and your website · Google Search Central, Dec. 10, 2025Supports: Google says AI Overviews and AI Mode need no new machine readable files, AI text files or markup.
  3. Overview of OpenAI Crawlers · OpenAI, Oct. 29, 2026Supports: Checked Oct. 29, 2026, for the effect of opting out of OAI-SearchBot on ChatGPT search answers.

Related questions

Intrica gets crypto, fintech and AI companies named in AI answers. AI search optimization →