AI model crawlers

Reflectionbot

Reflection AI's web crawler. It visits publicly available web pages to help build and improve the company's (open) AI models; it is currently the only user agent Reflection AI crawls with.

Dossier

Operator: Reflection AI
Documentation: reflection.ai
robots.txt token: Reflectionbot
Feeds: model training
Follows robots.txt: Yes, per its documentationDocs: reads and honors robots.txt (changes picked up within about a day); match on the Reflectionbot token, not the full UA.
How to verify: Published IP ranges and reverse DNSreflection.ai
Names in our logs: reflectionbot
Researched: 23 Oct 2026

Observed on New Runtime

Baseline 2026-10-23 · 93-day window · loading live numbers…

Requests: 2,345
Days active: 23 / 93
First seen: 1 Oct 2026
Last seen: 23 Oct 2026

Regularother_bot

Daily requests across the observed window, square-root scale.

Identity check claimed vs verified

No per-family identity check is published for this reader; its name is a claim.

What it reads crawler journeys · current window

The crawler-journeys aggregate tracks reading depth for the busiest named crawlers only; this family is not among them.

Sources

reflection.aireflection.ai/bot
knownagents.comknownagents.com/agents/reflectionbot