What Is llms.txt? A Practical Guide to Making Your Site Readable by AI
llms.txt explained: what the file is, why it matters for AI visibility (AEO), what to put in it, where to host it, and how to generate one in under a minute.
Shoppers increasingly ask ChatGPT, Perplexity and Gemini what to buy, and those engines answer by reading the web. A new, lightweight standard called llms.txt aims to make that reading easier: a single plain-text file that tells AI models what your site is about and which pages matter most. Here is what llms.txt actually is, why it is worth adding, what to put in it, and how to generate one in about a minute.
What is llms.txt?
llms.txt is a Markdown file you publish at the root of your domain, yourbrand.com/llms.txt, that gives large language models a concise, curated summary of your site. Instead of forcing an AI crawler to infer your business from a sprawling, JavaScript-heavy storefront, you hand it a clean map: who you are, what you sell, and links to the handful of pages you most want it to read and cite.
Think of it as a friendly briefing note for AI. It does not replace your website; it points to the best parts of it in a format a model can parse instantly.
How llms.txt differs from robots.txt and sitemap.xml
- robots.txt controls which crawlers are allowed to access your pages. It is about permission.
- sitemap.xml lists every URL you want indexed. It is about coverage.
- llms.txt describes your content for language models and highlights what matters. It is about context.
They work together, not instead of each other. An llms.txt file is pointless if your robots.txt is blocking the AI crawlers in the first place, so it is worth confirming both.
Why llms.txt matters for AI visibility (AEO)
Answer Engine Optimization (AEO) is the practice of getting your brand recommended inside AI answers. The models that produce those answers reward content they can read cleanly and attribute confidently. A well-formed llms.txt helps on both counts: it surfaces your strongest pages and states, in plain language, that you welcome being referenced and cited.
An honest caveat: llms.txt is an emerging, voluntary standard. Not every engine reads it yet, and adding it will not single-handedly move you up the rankings. But it is genuinely low-effort, it can only help, and it pairs naturally with the two things that do move the needle, allowing AI crawlers and adding structured data. Treat it as one clean input among several, not a silver bullet.
What goes in an llms.txt file
| Section | What it does |
|---|---|
| # Title | Your brand or site name, the top-level heading of the file |
| > Summary | A one-line description of what you offer |
| ## About | A short paragraph of context, category, who you serve |
| ## Key pages | Links to your most important pages: shop, FAQ, docs, warranty |
| ## Contact | How to reach you |
| ## Preferences | A note on how AI may use and cite the content |
Here is what a finished file looks like for a fictional outdoor brand:
# Acme Outdoors > Premium insulated bottles and hiking gear, built to last. ## About Acme Outdoors, acmeoutdoors.com. Insulated drinkware and trail gear for everyday adventurers. ## Key pages - [Shop](https://acmeoutdoors.com/shop) - [FAQ](https://acmeoutdoors.com/faq) - [Warranty](https://acmeoutdoors.com/warranty) ## Contact hello@acmeoutdoors.com ## Preferences - AI assistants and answer engines are welcome to reference this content and cite the source.
Where to host it
Publish the file at the root of your domain so it resolves at yourbrand.com/llms.txt. Some teams also add an expanded llms-full.txt with deeper detail for models that want more. Keep it in sync with your site, a stale llms.txt pointing at dead pages is worse than none.
Generate yours in under a minute
You do not need to hand-write the Markdown. Our free llms.txt Generator turns a few fields, brand, domain, summary, and your key pages, into a clean, ready-to-publish file you can copy and drop at your site root. No signup, no cost. Try it at useauspex.ai/tools/llms-txt-generator.
llms.txt is one piece of the AI-visibility puzzle
Adding llms.txt is a quick win, but it works best as part of a fuller AEO setup. Make sure AI crawlers like GPTBot, ClaudeBot, PerplexityBot and Google-Extended are actually allowed to reach your site (many storefronts quietly block them), add Product and FAQ structured data so engines can extract and attribute your content, and, most importantly, measure whether AI actually recommends you today. You can check all three for free: run the Robots.txt AI-Crawler Checker, generate schema with the Schema Generator, and run a free AI-visibility check to see where you stand across ChatGPT, Perplexity and Gemini.
FAQ
It is an emerging, community-driven convention rather than a formal spec ratified by a standards body. Adoption is growing and it is easy to add, but not every AI engine reads it yet, treat it as a helpful, low-cost signal, not a guarantee.
At the root of your domain, so it is reachable at yourbrand.com/llms.txt. Some sites also publish an expanded llms-full.txt alongside it.
No. A sitemap lists all your URLs for indexing; SEO earns rankings; llms.txt gives AI models a curated summary and pointers to your best pages. They complement each other.
Use the free llms.txt Generator at useauspex.ai/tools/llms-txt-generator, fill in your brand, domain, summary and key pages, then copy the generated file to your site root.
Run a free instant check. No signup required.