Google-Extended
Honors robots.txtGoogle-Extended controls whether your content can be used to train and ground Google's generative AI features (Gemini, AI Overviews), separate from classic Search indexing, which is handled by standard Googlebot instead.
- User-agent
- Google-Extended
- Operator
Allow in robots.txt
User-agent: Google-Extended
Allow: /Block in robots.txt
User-agent: Google-Extended
Disallow: /Blocking Google-Extended does not remove you from classic Google Search or guarantee exclusion from every AI Overview, since some are grounded on the standard index via Googlebot rather than Google-Extended alone.
Google-Extended vs Googlebot: a distinction worth understanding
It's easy to assume Google has one crawler, but Google-Extended and Googlebot control genuinely different things. Googlebot governs whether you appear in classic Google Search at all, including the organic results AI Overviews draw many of their sources from. Google-Extended is a separate, additional permission specifically for AI training and grounding. A site can allow Googlebot (essential for any organic visibility) while blocking Google-Extended (opting out of AI-specific use), though in practice most brands pursuing GEO allow both, since AI Overviews increasingly matter as much as the organic results beneath them.