---
schema_version: "newruntime-reader-dossiers-v1"
type: "reader_dossier"
slug: "google-extended"
kind: "ai_training"
operator: "Google"
researched_at: "2026-10-23"
confidence: "high"
json_url: "https://newruntime.com/readers/google-extended.json"
canonical_url: "https://newruntime.com/readers/google-extended/"
---

# Google-Extended

> Not a crawler: a standalone robots.txt product token that lets publishers control whether content crawled by Google may be used to train future Gemini models and for grounding in Gemini Apps and Vertex AI. It has no separate HTTP user-agent string; crawling uses existing Google user agents.

## Dossier

- Kind: AI model crawlers
- Operator: Google (https://www.google.com/)
- Documentation: https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers
- robots.txt tokens: Google-Extended
- Feeds: model training
- Respects robots.txt: Yes, per its documentation. Addressed via its own user-agent group in robots.txt; does not affect Google Search inclusion or ranking. Because Google never sends 'Google-Extended' as a request UA, any request carrying it (our 'Google-Extended token probe') is not Google.
- Verification: No published method
- Labels matched in our logs: google-extended

## Why it matters to New Runtime (our interpretation)

The robots.txt switch governing Gemini training/grounding use of New Runtime; request-level hits claiming it are spoofed probes, not Google.

## Observed behaviour

- Baseline 2026-10-23 (93-day window): 106 requests on 7 days; first seen 2026-07-24, last seen 2026-09-25; Dormant.
- Live numbers: https://newruntime.com/bot-traffic-history.json and https://newruntime.com/crawler-journeys.json

## Sources

- https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers

Identity: A family name is what a client claims in its user agent. It is verified only when its request came from the operator's published IP ranges or passed forward-confirmed reverse DNS, as reported per family in /crawler-journeys.json. Anyone can claim any name.

All dossiers: https://newruntime.com/readers.md