---
schema_version: "newruntime-reader-dossiers-v1"
type: "reader_dossier"
slug: "bytespider"
kind: "ai_training"
operator: "ByteDance"
researched_at: "2026-10-23"
confidence: "medium"
json_url: "https://newruntime.com/readers/bytespider.json"
canonical_url: "https://newruntime.com/readers/bytespider/"
---

# Bytespider

> ByteDance crawler described by secondary sources as an AI data scraper, allegedly used to build training data for ByteDance LLMs such as Doubao. No operator documentation was opened.

## Dossier

- Kind: AI model crawlers
- Operator: ByteDance (https://www.bytedance.com/)
- Documentation: none found
- robots.txt tokens: Bytespider
- Feeds: model training
- Respects robots.txt: Not documented. Secondary source lists it as expected to follow robots.txt, but ByteDance publishes no verification method; compliance unconfirmed.
- Verification: No published method
- Labels matched in our logs: bytespider

## Why it matters to New Runtime (our interpretation)

Training read for Chinese-market models; heavy bursty traffic with no attribution back to New Runtime.

## Observed behaviour

- Baseline 2026-10-23 (93-day window): 29 requests on 4 days; first seen 2026-09-11, last seen 2026-10-21; Returning.
- Live numbers: https://newruntime.com/bot-traffic-history.json and https://newruntime.com/crawler-journeys.json

## Sources

- https://knownagents.com/agents/bytespider

Identity: A family name is what a client claims in its user agent. It is verified only when its request came from the operator's published IP ranges or passed forward-confirmed reverse DNS, as reported per family in /crawler-journeys.json. Anyone can claim any name.

All dossiers: https://newruntime.com/readers.md