Google-Extended

Google-Extended is a robots.txt setting that lets you stop Google from using your pages to train Gemini, without affecting Google Search.

TechnicalUpdated 1 min read

Also called Google Extended

What it is

Google-Extended isn't a separate crawler. It's a name you can use in robots.txt to tell Google whether pages it crawls may be used for training Gemini models and for some Gemini features. Google introduced it in 2023.

What it doesn't do

It doesn't affect Google Search, and it doesn't keep you out of AI Overviews or AI Mode. Those use Google's normal crawler, Googlebot. The only way to leave them is to leave Google Search.

Should you block it?

For most businesses that want to be recommended by AI, no. Blocking it means future Gemini models learn less about you from your own site. Publishers that want to protect their writing are the main users.

Example

A recipe site blocks Google-Extended to protect its content from AI training. It still appears in Google Search and still gets cited in AI Overviews, because those use Googlebot.

Free tool: Robots.txt Generator for AIChoose which AI crawlers may read your site and get a robots.txt that keeps your existing rules.Try it →

Frequently asked questions

How do I block Google-Extended?

Add a rule to robots.txt: "User-agent: Google-Extended" then "Disallow: /".

Does it affect Google rankings?

No. Google says it isn't a ranking signal.

Can I keep my site out of AI Overviews?

Only by limiting Googlebot or using snippet controls like nosnippet, which also affect normal search results.

Go deeper

All posts →

Make AI search your next revenue channel

Start free trial