AI search glossary
Google-Extended
Google-Extended is a robots.txt token, not a crawler. Google states it has no user agent string of its own and never fetches anything: crawling is done by existing Google crawlers, and the token signals whether content may train Gemini models, including those behind Search’s AI features, and ground Gemini apps. Google-Extended does not affect Search inclusion or ranking.
What does Google-Extended actually control?
Training and grounding, and the training half now reaches Search. Google documents Google-Extended as governing whether your content is used for “training future generations of Gemini models that power Gemini Apps and Vertex AI API for Gemini”, and for grounding in those same products. Google’s Search Console help adds that Google-Extended is how a site limits “training of the models used to generate responses in Search generative AI features”. So Google-Extended decides whether Google may use your content to train Gemini models, including the models behind AI Overviews and AI Mode, and to ground Gemini apps.
What it does not touch is stated equally plainly: Google-Extended “does not impact a site’s inclusion in Google Search nor is it used as a ranking signal in Google Search”. Your organic positions cannot move because of this token, in either direction. So it is one of the few AI controls with no search cost attached to either choice, which makes it worth setting deliberately rather than leaving at the default.
Does Google-Extended turn off AI Overviews?
No, and this is the most repeated error in AI crawler advice after the GPTBot one. AI Overviews are part of Google Search, built from ordinary Googlebot crawling, and Google’s position is that “AI is built into Search and integral to how Search functions”, so the control is the robots.txt directive for Googlebot rather than a separate token.
The control that does is in Search Console. Its Search generative AI setting, under Settings, removes a site from AI Overviews and AI Mode and leaves its ordinary results untouched, and it has applied to every site since 31 August 2026. It works per Search Console property, so a URL-prefix property can take one section of a site out while the rest stays eligible.
For single pages, nosnippet, max-snippet and noindex still limit what an AI Overview may use, and each one also changes the ordinary result. max-snippet with a small number caps how much of a page can be quoted anywhere rather than turning anything off. Whether a shorter snippet makes you less useful to quote or simply less quoted is not something anybody has measured, so treat it as a lever with a known price and an unknown benefit.
Why will Google-Extended never appear in your logs?
Because nothing sends it. Google is explicit that “Google-Extended doesn’t have a separate HTTP request user agent string” and that the token is used “in a control capacity”. So an access log will never carry a Google-Extended line, no verification is possible or needed, and a tool that reports Google-Extended as blocked or allowed is reporting your own robots.txt back to you rather than any observed behaviour.
That is a useful thing to report, as long as it is labelled as policy. Be suspicious of any AI crawler audit that shows Google-Extended in a column of live response codes, because there is nothing there to respond. The same caution applies to Applebot-Extended, which works the same way and is misread the same way.
Where does this show as policy rather than evidence?
From RankX AIAI Crawler Access CheckerReports Google-Extended as a robots.txt policy row with no live probe beside it, because there is no crawler to probe.Related terms
- AI OverviewAn AI Overview is the written summary Google places above its ordinary search results, assembled from web pages and shown with links to a few of them.
- Google AI ModeGoogle AI Mode is a conversational search surface where a written answer replaces the ranked results page rather than sitting above it.
- GPTBotGPTBot is OpenAI’s training crawler.
- AI CitationAn AI citation is a link an AI assistant attaches to its answer, naming a page as a source.
This definition of Google-Extended was checked against the following sources. Definitions are reviewed quarterly and edited only when they are wrong, so the reviewed date above moves on a real correction and not on a schedule.
- Google Search Central: Google crawlers and user agents (opens in a new tab), read 18 August 2026
- Google Search Console Help: the Search generative AI control (opens in a new tab), read 29 September 2026
- Google Search Central: optimizing for generative AI features on Google Search (opens in a new tab), read 29 September 2026
Every entry is listed on the RankX AI glossary index, and this page is available as Markdown at /glossary/google-extended.md.
Start here
See where you show up in AI answers today.
Add your site and RankX AI suggests prompts, tracks your keywords and audits your pages, with first results minutes after setup.
7-day free trial. No credit card required. Cancel anytime.