What it is
A sitemap is a file, usually at yoursite.com/sitemap.xml, that lists your important pages. Each entry can include a "lastmod" date saying when the page last changed.
Why it matters for AI search
AI engines that search the web rely on search indexes like Google's and Bing's, and on their own crawlers. A sitemap helps all of them find new and updated pages quickly, especially pages that few other pages link to.
Because AI prefers fresh pages for buying questions, getting updates crawled fast matters.
Good practice
- List only pages you want found: no redirects, no error pages, no duplicates.
- Keep lastmod honest. Change it only when the content changes.
- Point to it in robots.txt with a "Sitemap:" line.
- Submit it in Google Search Console and Bing Webmaster Tools.
Example
A blog updates its "best tools of 2026" post, but its sitemap still shows last year's date. Crawlers take weeks to notice the update. After fixing the sitemap to show real update dates, updates get picked up in days.
Frequently asked questions
Do AI crawlers read sitemaps?
Many crawlers do. Search engines certainly do, and AI search runs on their results.
How big can a sitemap be?
Up to 50,000 URLs per file. Large sites use several, listed in a sitemap index.
Is a sitemap the same as llms.txt?
No. A sitemap lists all pages for crawlers. llms.txt is a short guide to your most useful pages.