AI search & answer engines
Claude-SearchBot
Navigates the web to improve the relevance and accuracy of Claude's search results.
Dossier
- Operator
- Anthropic
- Documentation
- support.claude.com
- robots.txt token
Claude-SearchBot- Feeds
- search index
- Follows robots.txt
- Yes, per its documentationDisallowing it prevents indexing for search optimization and may reduce visibility in Claude search results.
- How to verify
- Published IP rangesclaude.com
- Names in our logs
claude-searchbot- Researched
- 23 Oct 2026
Observed on New Runtime
Baseline 2026-10-23 · 93-day window · loading live numbers…
- Requests
- 43
- Days active
- 4 / 93
- First seen
- 24 Jul 2026
- Last seen
- 21 Oct 2026
Returningai_crawler
Identity check claimed vs verified
- not verifiable6 reqprovider not published
What it reads crawler journeys · current window
- Content pages0
- Feeds & discovery0
- Machine-consumption0
0 unique materials · 0 canonical pages
Enters at · 7 days
Leaves from · 7 days
Sources
- support.claude.comsupport.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler