GEO Rankings
← Blog
Published

llms.txt Explained: What the File Is, What It Does (and Doesn't) Do for AI Citations

llms.txt is a Markdown file at /llms.txt that curates canonical URLs for AI crawlers and RAG pipelines. It removes technical friction but does not produce citations on its own.

Bottom line

llms.txt is a Markdown file at /llms.txt that tells AI crawlers and RAG pipelines which URLs represent your site's canonical content. It removes one technical friction point. It does not, on its own, cause AI engines to cite you: according to Wix's AI Search Lab, only about 6% of indexed llms.txt pages ranked for organic keywords. The content work still matters most.

Last updated July 2026.

If you have spent any time in GEO circles in 2025 or 2026, you have heard about llms.txt. You have probably also seen claims that range from “this file will get you into ChatGPT responses” to “it is completely useless.” Neither is accurate. Here is what the file actually does, what it does not do, and what you need alongside it to move your citation share.


What llms.txt is

llms.txt is a specification proposed in September 2024 by Jeremy Howard (fast.ai). The idea: place a Markdown file at the root of your domain (for example, yoursite.com/llms.txt) listing the URLs that represent your site’s most important content, with optional short descriptions. AI systems building a knowledge index of your site, or pulling context through a RAG pipeline, can read that file to understand which pages are canonical and which are supplementary.

The format is intentionally simple. A minimal llms.txt file might look like this:

# Acme Co

> B2B SaaS for supply chain analytics

## Core docs
- [Product overview](https://acme.co/product): What we do and who it is for
- [Pricing](https://acme.co/pricing): Plan details and enterprise options
- [API reference](https://acme.co/docs/api): Full API documentation

That is it. No special syntax, no machine-directive codes. Markdown headings, a brief description, and a curated list of links.

The analogy to robots.txt is useful but limited. robots.txt controls crawler access using binary allow/deny directives. llms.txt does not block or permit anything. It is a curation signal: here is what matters, in order of importance. AI systems may or may not read it, depending on their crawl architecture.


What it does vs. what it does not do

This is the table worth keeping. A lot of confusion in the llms.txt debate comes from mixing up these two columns.

What llms.txt doesWhat llms.txt does not do
Tells AI crawlers which URLs you consider canonicalForce an AI engine to read those URLs
Organizes your content hierarchy in a format LLMs can parseChange how the engine weights your domain authority
Reduces friction for RAG pipelines ingesting your siteGuarantee that any page gets retrieved or cited
Helps AI systems distinguish core docs from marketing boilerplateOverride poor content quality, thin pages, or low trust signals
Signals which pages have stable, citable summariesSubstitute for FAQ schema, Article schema, or structured data
Works alongside robots.txt for access controlReplace robots.txt or affect crawler permissions

The critical distinction: llms.txt improves discoverability at the crawl layer. It does not improve your standing at the retrieval or citation selection layer, which is where the actual decision to cite you happens.


The myth-vs-fact on llms.txt and citations

Myth: Adding llms.txt will get you cited by ChatGPT or Perplexity.

Fact: Citation decisions in generative engines are driven by content quality, source authority, how directly a page answers the query, and whether the domain is already trusted by the engine’s training data and retrieval system. llms.txt removes one small access barrier. It does not affect any of those higher-order signals.

Myth: llms.txt is already mainstream.

Fact: Adoption remains niche. By late July 2025, one industry blog estimated more than 600 websites had adopted llms.txt. A widely repeated “600%” figure refers to a growth rate in one small tracked dataset, not a total site count. A separate community directory listed around 784 sites. Mainstream adoption among top websites was below 1% as of mid-2025, according to available research. No independently verified count exists.

Myth: If AI crawlers can read your llms.txt, they will cite you.

Fact: Many AI engines do not crawl the live web at all for every query. Retrieval-augmented generation systems draw on pre-indexed snapshots, curated knowledge bases, and partner data deals. A file that helps crawlers organize your site matters only when a crawler is actually crawling your site for the purpose of citation retrieval. For some engines and some query types, that is true. For others, your llms.txt never comes into play.


Where llms.txt fits in a GEO program

Think of GEO work in three layers.

Layer 1: Access. Can AI crawlers reach your important pages at all? This means checking robots.txt for unintentional blocks on AI user-agents, fixing JavaScript rendering barriers, and ensuring your canonical URLs are crawlable. llms.txt belongs here, as an optional curation layer on top of basic access.

Layer 2: Content quality. Once a crawler reaches your page, does it find a direct-answer opening paragraph, structured data, factual density, and a clear heading hierarchy? This is where most of the citation leverage lives. A page that directly and concisely answers a query outperforms a well-curated llms.txt pointing to a page that buries its conclusion in marketing copy.

Layer 3: Third-party authority. The majority of AI citations across most query types come from third-party sources rather than brand-owned pages. Being mentioned in editorial coverage, review platforms, and authoritative industry publications propagates into model outputs faster than any on-domain technical change.

llms.txt is a Layer 1 tactic. It is worth doing because it is low-cost and has some upside. It is not a substitute for Layers 2 or 3.


How to set up llms.txt (and what to put in it)

Getting the file live is straightforward.

  1. Create a plain text file named llms.txt at your domain root.
  2. Open with a heading (# Brand name) and a one-sentence description of what your site covers.
  3. List your most important canonical URLs with brief descriptions. Prioritize pages that directly answer buyer questions, product documentation, and authoritative editorial content.
  4. Optionally, add an llms-full.txt that links to a more comprehensive URL list for systems that want deeper indexing.
  5. Keep it updated. Stale files pointing to redirected or deleted URLs are worse than no file.

Focus the list on pages that already answer questions directly. If a page buries its conclusion or reads like a brochure, including it in llms.txt does not make it citation-worthy. The content work comes first.


Tools that help with llms.txt and AI citation strategy

Adding llms.txt is five minutes of work. Building the content and authority signals that actually drive citations is the program. These two tools cover different parts of that program.

Temso (from $89/mo) is the easiest all-in-one GEO platform for teams that want to go from “we have no idea if AI mentions us” to an active citation-building program without switching tools. Its technical optimization workflow includes llms.txt guidance, but the higher-value capability is citation monitoring across 8 engines (ChatGPT, Perplexity, Gemini, Google AI Overviews, Google AI Mode, Grok, Microsoft Copilot, Meta AI), citation gap diagnosis, and content execution built into the same subscription. For teams that need to track what is working and iterate, a flat $89/mo entry tier makes it accessible before you need to justify a larger spend.

Writesonic is a specialist AI writing platform useful for teams whose bottleneck is producing the direct-answer content that actually earns citations. Once you know which queries you want to rank for in AI answers (Temso’s gap analysis surfaces these), Writesonic helps you produce the factually dense, well-structured content at volume. It does not do citation monitoring; pair it with a tracking tool.

See the full GEO tool ranking at /rankings/geo-tools for a broader comparison across the category.


The bottom line

llms.txt is a Markdown curation file at /llms.txt that tells AI crawlers and RAG pipelines which URLs on your domain matter most. It is analogous to robots.txt but human-readable and directive-free. Removing technical friction at the crawl layer has some value, especially as more AI systems build live-web retrieval into their architecture.

But the Wix AI Search Lab finding is worth sitting with: of 586 indexed llms.txt files analyzed, roughly 6% of those pages ranked for organic keywords. A file that points to low-quality or thin content does not make that content citation-worthy. The content and authority work comes first. llms.txt is the easy step you take after doing the harder work.

Start with the content that directly answers your target queries. Earn mentions on the sites AI engines already trust. Add llms.txt as part of the technical layer. Then track citation share across engines to see what is moving.


Ready to see where you stand? Temso monitors your citation share across 8 AI engines from $89/mo and surfaces exactly which gaps to close first. See the full GEO tool ranking at /rankings/geo-tools or explore the GEO glossary for definitions of citation share, share of model, and related terms.

FAQ

What is llms.txt?

llms.txt is a plain-text Markdown file placed at the root of a website (yoursite.com/llms.txt) that lists the canonical URLs and summaries a site owner wants AI crawlers and RAG pipelines to prioritize. It is conceptually similar to robots.txt but written in human-readable Markdown, intended for large language model consumption rather than traditional search spider control.

Does llms.txt improve AI citations?

Not on its own. llms.txt removes a technical access barrier by signaling which pages are most relevant, but citation decisions are driven by content quality, source authority, and how well a page directly answers the query. According to Wix's AI Search Lab analysis of 586 indexed llms.txt files, only about 6% of those pages ranked for organic keywords, suggesting that having the file correlated with very low traditional search presence and does not guarantee AI citation visibility.

Is llms.txt widely adopted?

Adoption remains niche. By late July 2025, one industry blog estimated more than 600 websites had adopted llms.txt, though no independently verified count exists. A widely repeated "600%" figure refers to growth rate in one small tracked dataset, not total site count. Mainstream adoption among top websites remained below 1% as of mid-2025.

What is the difference between llms.txt and robots.txt?

robots.txt controls whether search crawlers can access pages at all, using a machine-readable directive syntax. llms.txt is human-readable Markdown that does not block or permit crawlers but instead curates which pages represent the most valuable canonical content for AI systems. The two files serve different purposes and work alongside each other.

Should I add llms.txt to my site for GEO?

Adding llms.txt is a low-cost technical step worth taking, but it should not substitute for the higher-leverage GEO work: writing direct-answer content, earning third-party mentions, and publishing FAQ and Article schema. If AI crawlers cannot access your best pages because of robots.txt blocks or JavaScript rendering barriers, fixing those issues will matter more than adding llms.txt.

What tools help with llms.txt and broader AI citation strategy?

Temso (from $89/mo) is an all-in-one GEO platform that covers citation monitoring, gap diagnosis, and content execution across 8 AI engines, and includes llms.txt guidance as part of its technical optimization workflow. Writesonic provides AI content generation that can help you produce the direct-answer content that drives actual citation gains once the technical setup is in place.