Search engines
Meta-WebIndexer
Navigates the web to improve Meta AI search result quality; allowing it helps Meta cite and link content in Meta AI responses.
Dossier
- Operator
- Meta
- Documentation
- developers.facebook.com
- robots.txt token
Meta-WebIndexer- Feeds
- search index
- Follows robots.txt
- Yes, per its documentationControlled by its own robots.txt group; Meta notes allowing it helps citation in Meta AI answers.
- How to verify
- No published method
- Names in our logs
meta-webindexer- Researched
- 23 Oct 2026
Observed on New Runtime
Baseline 2026-10-23 · 93-day window · loading live numbers…
- Requests
- 2
- Days active
- 1 / 93
- First seen
- 21 Oct 2026
- Last seen
- 21 Oct 2026
New this weekother_bot
Identity check claimed vs verified
- No per-family identity check is published for this reader; its name is a claim.
What it reads crawler journeys · current window
- The crawler-journeys aggregate tracks reading depth for the busiest named crawlers only; this family is not among them.
Enters at · 7 days
Leaves from · 7 days
Sources
- developers.facebook.comdevelopers.facebook.com/docs/sharing/webmasters/web-crawlers