What it is
llms.txt is a text file you put at the root of your site, like yoursite.com/llms.txt. It's written in Markdown and tells AI tools, in a few lines, what your site is about and which pages matter most.
Jeremy Howard of Answer.AI proposed it in September 2024. The idea: web pages are full of menus, scripts and ads, and a short clean summary is easier for an AI to use.
What goes in it
A typical llms.txt has:
- A heading with your company or site name
- One or two sentences on what you do
- Short lists of links to your key pages, each with a one-line description: products, pricing, docs, guides
Some sites also publish an llms-full.txt with the full text of their main pages.
Do AI engines use it?
This is the important part. No major AI search engine has said it reads llms.txt when it answers questions. Google has said its AI search features don't need it. Some AI coding tools and developer docs use it, which is where it's most common.
In the research on what gets brands recommended, llms.txt hasn't been tested as a factor. So we can't say it helps.
Should you add one?
It takes ten minutes and can't hurt, so it's fine to add. But don't expect it to change whether AI recommends you. In our study, what mattered most was being on the "best X" lists the AI read: 90% of recommended brands were on one.
Example
A software company adds a file at example.com/llms.txt. It starts with one line about what the product does, then lists links to its pricing page, docs and comparison pages, each with a short note.
An AI tool that supports the file can read it to find the important pages quickly, instead of crawling the whole site.
Frequently asked questions
Is llms.txt the same as robots.txt?
No. robots.txt tells crawlers what they may and may not fetch. llms.txt is a guide to your content. If you want to allow or block AI tools, that's done in robots.txt. See AI crawlers.
Will llms.txt get my site into ChatGPT?
There's no evidence it does. ChatGPT finds pages through web search. Being on pages that rank for your buyers' questions matters far more.
Where does llms.txt go?
At the root of your domain, like yoursite.com/llms.txt, as a plain Markdown file.
Is it worth the time?
It takes under an hour and does no harm. Just don't expect it to change your AI visibility on its own. Getting onto the pages AI cites matters far more.