Agentic web & MCP registries

AgentTrustBot

Crawler for the agenttru.st directory of AI agents. It discovers hostnames from public Certificate Transparency logs and checks well-known discovery paths (agent cards, MCP server cards) and DNS records (ANS, DNS-AID) for published agents, plus icon fetches and re-checks of listed agents. Formerly AgentTrust-Collector.

Dossier

Operator: agenttru.st
Documentation: agenttru.st
robots.txt token: agenttrustbotagenttrust-collector
Feeds: registry / directory
Follows robots.txt: Yes, per its documentationDocs: reads robots.txt per host before other requests; legacy token agenttrust-collector still honored; opted-out hosts not rechecked for 180 days.
How to verify: Published IP ranges and reverse DNSagenttru.st
Names in our logs: agenttrustbot
Researched: 23 Oct 2026

Observed on New Runtime

Baseline 2026-10-23 · 93-day window · loading live numbers…

Requests: 6
Days active: 1 / 93
First seen: 14 Sept 2026
Last seen: 14 Sept 2026

Dormantother_bot

Daily requests across the observed window, square-root scale.

Identity check claimed vs verified

No per-family identity check is published for this reader; its name is a claim.

What it reads crawler journeys · current window

The crawler-journeys aggregate tracks reading depth for the busiest named crawlers only; this family is not among them.

Sources

agenttru.stagenttru.st/crawler
botcrawl.combotcrawl.com/bots/agenttrust-collector/