NEW RUNTIME

AI model crawlers

ClaudeBot

Anthropic

Anthropic's crawler collecting public web content that may contribute to training its generative AI models.

Dossier

Operator
Anthropic
Documentation
support.claude.com
robots.txt token
ClaudeBot
Feeds
model training
Follows robots.txt
Yes, per its documentationDisallowing ClaudeBot excludes future materials from training datasets; supports non-standard Crawl-delay; Anthropic advises robots.txt over IP blocking.
How to verify
Published IP rangesclaude.com
Names in our logs
claudebot
Researched
23 Oct 2026

Observed on New Runtime

Baseline 2026-10-23 · 93-day window · loading live numbers…

Requests
3,677
Days active
62 / 93
First seen
23 Jul 2026
Last seen
23 Oct 2026
Regularai_crawler

Daily requests across the observed window, square-root scale.

Identity check claimed vs verified

  • not verifiable42 reqprovider not published

What it reads crawler journeys · current window

  • Content pages0
  • Feeds & discovery38
  • Machine-consumption0

0 unique materials · 0 canonical pages

Sources

  1. support.claude.comsupport.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate…

Open the JSON contract