Google-Extended
by Google
Training crawlers · Model data
A robots.txt control that lets you opt out of your content being used to train Gemini models.
There is no separate Google-Extended crawler: pages are fetched by Google's existing crawlers. It doesn't affect Google Search ranking.
Crawlers (or robots.txt controls) that collect public content used to train AI models.
Control it with robots.txt
Google-Extended is a robots.txt control only: add these lines to opt out.
robots.txt
User-agent: Google-Extended Disallow: /
Blocking AI search and answer crawlers can also remove your pages from AI answers and citations. Weigh traffic from AI assistants before blocking them. Official documentation: developers.google.com.