llms.txt

llms.txt is a proposed plain-text file at the root of a website that gives AI tools a short summary of the site and links to its most useful pages.

TechnicalUpdated 2 min read

Also called llms.txt file · LLMs.txt

What it is

llms.txt is a text file you put at the root of your site, like yoursite.com/llms.txt. It's written in Markdown and tells AI tools, in a few lines, what your site is about and which pages matter most.

Jeremy Howard of Answer.AI proposed it in September 2024. The idea: web pages are full of menus, scripts and ads, and a short clean summary is easier for an AI to use.

What goes in it

A typical llms.txt has:

  • A heading with your company or site name
  • One or two sentences on what you do
  • Short lists of links to your key pages, each with a one-line description: products, pricing, docs, guides

Some sites also publish an llms-full.txt with the full text of their main pages.

Do AI engines use it?

This is the important part. No major AI search engine has said it reads llms.txt when it answers questions. Google has said its AI search features don't need it. Some AI coding tools and developer docs use it, which is where it's most common.

In the research on what gets brands recommended, llms.txt hasn't been tested as a factor. So we can't say it helps.

Should you add one?

It takes ten minutes and can't hurt, so it's fine to add. But don't expect it to change whether AI recommends you. In our study, what mattered most was being on the "best X" lists the AI read: 90% of recommended brands were on one.

Example

A software company adds a file at example.com/llms.txt. It starts with one line about what the product does, then lists links to its pricing page, docs and comparison pages, each with a short note.

An AI tool that supports the file can read it to find the important pages quickly, instead of crawling the whole site.

Free tool: llms.txt GeneratorBuild an llms.txt from your sitemap in seconds, or check the one you have against the spec.Try it →

Frequently asked questions

Is llms.txt the same as robots.txt?

No. robots.txt tells crawlers what they may and may not fetch. llms.txt is a guide to your content. If you want to allow or block AI tools, that's done in robots.txt. See AI crawlers.

Will llms.txt get my site into ChatGPT?

There's no evidence it does. ChatGPT finds pages through web search. Being on pages that rank for your buyers' questions matters far more.

Where does llms.txt go?

At the root of your domain, like yoursite.com/llms.txt, as a plain Markdown file.

Is it worth the time?

It takes under an hour and does no harm. Just don't expect it to change your AI visibility on its own. Getting onto the pages AI cites matters far more.

Go deeper

All posts →
Research

AI product recommendations are mostly a summary of listicles

We fetched every 'best X' page ChatGPT, Gemini and Google AI cited in 839 answers. 90% of the brands they recommended were on one of those lists. Brands on none were recommended 2.5% of the time. Here's how it works and what to do about it.

Make AI search your next revenue channel

Start free trial