Agentic web & MCP registries

AgenstryBot

Crawler for Agenstry, an AI agent directory for A2A and MCP that publishes measured evidence about public agent infrastructure. It fetches .well-known A2A cards and MCP manifests, sitemaps and metadata, may send a JSON-RPC ping or MCP initialize/tools/list, and rechecks live agents roughly hourly.

Dossier

Operator: Agenstry
Documentation: agenstry.com
robots.txt token: AgenstryBot
Feeds: registry / directory, monitoring
Follows robots.txt: Yes, per its documentationDocs: honors Allow/Disallow/Crawl-delay for AgenstryBot, caches rules up to 1h, backs off on 429/503; blocking stops fresh evidence but keeps the listing. Requests are signed with Web Bot Auth (RFC 9421, Ed25519, Signature-Agent https://agenstry.com) from one GCP europe-west1 host; listed by Cloudflare as a verified bot.
How to verify: Signed requests (Web Bot Auth)agenstry.com
Names in our logs: agenstrybot
Researched: 23 Oct 2026

Observed on New Runtime

Baseline 2026-10-23 · 93-day window · loading live numbers…

Requests: 73
Days active: 9 / 93
First seen: 4 Oct 2026
Last seen: 22 Oct 2026

Returningother_bot

Daily requests across the observed window, square-root scale.

Identity check claimed vs verified

No per-family identity check is published for this reader; its name is a claim.

What it reads crawler journeys · current window

The crawler-journeys aggregate tracks reading depth for the busiest named crawlers only; this family is not among them.

Sources

agenstry.comagenstry.com/
agenstry.comagenstry.com/bot
agent-tools.cloudagent-tools.cloud/about