What is llms.txt?
llms.txt is a proposed plain text file, placed at the root of a website, that tells AI tools what the site is and which pages matter most. It is written in simple Markdown, so a large language model can read it in one pass instead of crawling hundreds of pages to work out what you do.

Where llms.txt sits in the buying journey
Topic: AI search
How it connects to other terms
What goes inside an llms.txt file?
The format is deliberately simple. It starts with the site or brand name as a heading, a one or two line summary, and then short sections of links, each with a sentence explaining the page. A services firm might list its service pages, pricing, about page, key guides and contact page.
- A top heading with your brand name.
- A short quote block describing what you do, for whom and where.
- Sections such as Services, Guides and Company, each a list of links with one line descriptions.
- Optionally, a link to a fuller version with more detail for tools that want it.
How many people search for llms.txt?
Search demand in India is still too small for Semrush to report, while the US sees about 3,600 searches a month for "llms.txt" (November 2026).
That gap is the opportunity: Indian businesses that explain this topic well now face very little local competition. In the US, ranking for it is winnable with a strong page and a few good links (Semrush difficulty 65 out of 100).
| Market | Monthly searches | Difficulty (0 to 100) |
|---|---|---|
| India | Too few to report | - |
| United States | 3,600 | 65 |
Source: Semrush keyword data for India and the US, November 2026. Volumes are estimates and change month to month.
Does llms.txt help you rank or get cited?
Honestly, nobody can promise that. It is a proposal, not a standard that every AI company has committed to, and Google has said it does not use it for search. Some AI tools and developer agents do read it, and it costs about an hour to write, so it is a sensible low cost addition rather than a ranking switch.
The real value is often internal. Writing a clean one paragraph description of your business and choosing your 20 most important pages forces the same clarity that AEO needs everywhere else.
How is llms.txt different from robots.txt and a sitemap?
robots.txt tells crawlers what they may and may not fetch. An XML sitemap lists every URL you want indexed, for search engines. llms.txt does neither job. It is a curated reading list for language models, with plain language descriptions, and it should list only the pages that best explain your business.
How do you set it up?
- Write the file in a text editor and save it as llms.txt.
- Upload it to the root of your domain so it loads at yourdomain.com/llms.txt.
- Check that your robots.txt does not block the AI crawlers you want to read it.
- Update it when you launch or retire an important page, the same way you would update navigation.
Who should own the llms.txt file?
Whoever owns your website navigation should own this file, because the decisions are the same: which pages matter most and how to describe them. In a small business that is usually the founder or marketing lead; in a larger team, the SEO lead.
Review it every quarter, or whenever you launch, rename or remove an important page. An outdated llms.txt that points to deleted pages sends AI tools to dead ends, which is worse than not having the file.
What is the real risk with llms.txt?
The real risk is a broken file, not a missing one. Chrome's Lighthouse now has an llms.txt audit: it marks a missing file (a 404) as not applicable because the file is optional, and it flags pages where the server errors when it tries to fetch the file. The Semrush guide notes that no AI platform has confirmed using the file, and Google says you do not need it.
That combination gives a clear rule. A clean 404 costs you nothing. A server error, or a single page app that answers /llms.txt with its home page HTML and a 200 status, is worse than no file at all, because tools see a broken or misleading response.
- Open yoursite.com/llms.txt in a browser. You should see plain Markdown, or a proper 404 page.
- Check the response code with any header checker. It should be 200 for a real file and 404 for none.
- If you publish one, keep it short, link only pages you would happily have quoted, and update it when those pages change.
We read the five pages ranking for this term in November 2026 before writing this section. It covers what none of them did.
What is a good example?
A Pune B2B agency might open its file with one sentence saying it is a digital marketing studio in Pune offering SEO, AI search optimisation, content and B2B lead generation, plus Meta ads for restaurants. Below that come links to each service page, the free calculators and the glossary, each with a line on what the visitor will find. That is enough for an AI tool to describe the business correctly.
What else do people ask about llms.txt?
Is llms.txt required?
No. It is optional and experimental. Clear pages and good structured data matter far more.
Should llms.txt list every page?
No. Keep it to the pages that best explain what you do. Your sitemap already lists everything.
Can llms.txt hurt my SEO?
No. Search engines treat it as a normal text file, and it does not change how your pages are crawled.
Which terms should you read next?
Picked from the same topic and the terms this page links to.