Search engines
Googlebot
Generic name for Google Search's smartphone and desktop crawlers that fetch pages for the Google Search index (incl. Discover, Images, Video, News). Gemini training/grounding is controlled separately by the Google-Extended robots token.
Dossier
- Operator
- Documentation
- developers.google.com
- robots.txt token
GooglebotGooglebot-ImageGooglebot-VideoGooglebot-News- Feeds
- search index
- Follows robots.txt
- Yes, per its documentationrobots.txt blocks crawling, not indexing; use noindex to keep pages out. Google-Extended token governs Gemini training/grounding without affecting Search.
- How to verify
- Published IP ranges and reverse DNSdevelopers.google.com
- Names in our logs
googlebot- Researched
- 23 Oct 2026
Observed on New Runtime
Baseline 2026-10-23 · 93-day window · loading live numbers…
- Requests
- 1,788
- Days active
- 73 / 93
- First seen
- 23 Jul 2026
- Last seen
- 23 Oct 2026
Regularsearch_crawler
Identity check claimed vs verified
- verified193 reqofficial cidr
- claimed unverified8 reqofficial cidr
What it reads crawler journeys · current window
- Content pages0
- Feeds & discovery193
- Machine-consumption0
0 unique materials · 1 canonical pages
Enters at · 7 days
Leaves from · 7 days
Sources
- developers.google.comdevelopers.google.com/search/docs/crawling-indexing/googlebot
- developers.google.comdevelopers.google.com/search/docs/crawling-indexing/google-common-crawlers
- developers.google.comdevelopers.google.com/search/docs/crawling-indexing/verifying-googlebot
- developers.google.comdevelopers.google.com/static/search/apis/ipranges/googlebot.json