Home / Glossary / llms.txt
Glossary

What Is llms.txt?

A clear definition of llms.txt, how it differs from robots.txt, and what available evidence suggests about its effect on AI visibility.

Definition

llms.txt is a proposed plain-text file that website owners place at their domain root to communicate content access preferences and structured summaries to AI crawlers and large language models, modeled loosely on the robots.txt convention.

llms.txt in Plain Terms

The robots.txt file has existed since 1994 as a way for site owners to tell web crawlers which pages to index or skip. As AI systems began crawling the web to build training datasets and power retrieval-augmented responses, some practitioners proposed an equivalent file specifically for AI: llms.txt.

The idea is that a site owner could place a plain-text file at their domain root that tells AI crawlers what the site is about, which sections contain the most relevant content, and optionally which sections should not be used in AI training or responses. The format was proposed by Jeremy Howard and has been discussed in AI and SEO communities, but as of late 2026 it remains unofficial and unconfirmed by major AI platforms.

What an llms.txt File Contains

A typical llms.txt file includes:

The format is intentionally simple: plain text, readable by both machines and humans. Jeevan AI's own llms.txt file at jeevanai.co.in/llms.txt follows this convention.

What the Evidence Suggests

Published analysis of whether llms.txt files affect AI citation or recommendation rates is limited. Jeevan AI published a data-backed look at whether adding an llms.txt file correlates with measurable changes in AI visibility scores, which you can read in the does llms.txt work article. The short version: the effect, if any, appears modest compared to foundational factors like entity authority and content quality.

The safest current recommendation is to add one if you have a structured overview to offer, treat it as a signal rather than a solution, and focus primary effort on the factors with clearer evidence behind them.

llms.txt vs. robots.txt

FilePurposeStandard?Confirmed AI adoption?
robots.txtCrawl directives for all botsYes (RFC 9309)Yes, universally
llms.txtContent summary and AI-specific access preferencesNo (proposed)Unconfirmed by major platforms
sitemap.xmlURL index for search crawlersYesPartially

Frequently Asked Questions

What is llms.txt?

llms.txt is a proposed file at a website's root that gives AI crawlers a structured summary of site content and access preferences. It follows the spirit of robots.txt but targets AI systems specifically. It is not yet an official standard.

Do major AI platforms read llms.txt?

As of late 2026, no major AI platform (ChatGPT, Perplexity, Gemini, Claude) has officially confirmed reading or acting on llms.txt. Some practitioners add it as a low-cost potential signal while the ecosystem develops.

Is llms.txt worth adding to my site?

Adding it is low-effort. If AI systems adopt it as a standard, having one in place may help. If they do not, the file causes no harm. It should not replace higher-impact work like building entity authority and earning citations.

Where can I see an example llms.txt?

Jeevan AI's own llms.txt is published at jeevanai.co.in/llms.txt and covers the site's main content areas and purpose.

Check What AI Systems Actually Know About Your Brand.

A scan shows what AI says about your brand today, which is more actionable than any file format.

Start Free Scan