---
schema_version: "newruntime-reader-dossiers-v1"
type: "reader_dossier"
slug: "claudebot"
kind: "ai_training"
operator: "Anthropic"
researched_at: "2026-10-23"
confidence: "high"
json_url: "https://newruntime.com/readers/claudebot.json"
canonical_url: "https://newruntime.com/readers/claudebot/"
---

# ClaudeBot

> Anthropic's crawler collecting public web content that may contribute to training its generative AI models.

## Dossier

- Kind: AI model crawlers
- Operator: Anthropic (https://www.anthropic.com/)
- Documentation: https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler
- robots.txt tokens: ClaudeBot
- Feeds: model training
- Respects robots.txt: Yes, per its documentation. Disallowing ClaudeBot excludes future materials from training datasets; supports non-standard Crawl-delay; Anthropic advises robots.txt over IP blocking.
- Verification: Published IP ranges (https://claude.com/crawling/bots.json)
- Labels matched in our logs: claudebot

## Why it matters to New Runtime (our interpretation)

Training reads shape how future Claude models understand the topics New Runtime covers.

## Observed behaviour

- Baseline 2026-10-23 (93-day window): 3,677 requests on 62 days; first seen 2026-07-23, last seen 2026-10-23; Regular.
- Reading mix (crawler journeys): 0 content reads, 38 feed or discovery reads, 0 machine-consumption reads; 0 unique materials.
- Identity check: not verifiable 42 requests.
- Live numbers: https://newruntime.com/bot-traffic-history.json and https://newruntime.com/crawler-journeys.json

## Sources

- https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler

Identity: A family name is what a client claims in its user agent. It is verified only when its request came from the operator's published IP ranges or passed forward-confirmed reverse DNS, as reported per family in /crawler-journeys.json. Anyone can claim any name.

All dossiers: https://newruntime.com/readers.md