---
schema_version: "newruntime-reader-dossiers-v1"
type: "reader_dossier_index"
count: 93
researched_at: "2026-10-23"
json_url: "https://newruntime.com/readers.json"
canonical_url: "https://newruntime.com/readers/"
---

# Visitor dossiers

> Who reads New Runtime by machine. One dossier per crawler or agent family seen in the public Readership observatory: who runs it, what it is designed to do, whether it follows robots.txt, how to verify it, and what it did here.

A family name is what a client claims in its user agent. It is verified only when its request came from the operator's published IP ranges or passed forward-confirmed reverse DNS, as reported per family in /crawler-journeys.json. Anyone can claim any name. purpose, operator, robots and verification facts come from the cited sources; why_it_matters is New Runtime's own interpretation. Family-level aggregates only; no IPs, visitor IDs or raw user agents.

Request counts below are a baseline from 2026-10-23 over 93 observed days, refreshed daily. Live: https://newruntime.com/bot-traffic-history.json.

## AI search & answer engines

Fetch or index pages so an AI assistant or AI search engine can answer a person's question, usually with a link back.

| Reader | Operator | Requests | Purpose |
| --- | --- | ---: | --- |
| [PerplexityBot / Perplexity-User](https://newruntime.com/readers/perplexitybot.md) | Perplexity | 4,689 | PerplexityBot surfaces and links websites in Perplexity search results and is not used to crawl content for AI foundation models. The separate Perplexity-User fetcher opens pages on user request to answer a question and link the page. |
| [OAI-SearchBot](https://newruntime.com/readers/oai-searchbot.md) | OpenAI | 4,407 | OpenAI's search crawler that surfaces and links websites in ChatGPT search features; not used for model training. |
| [ExaSearchBot / ExaUser](https://newruntime.com/readers/exa.md) | Exa | 2,234 | ExaSearchBot crawls public pages to index them for Exa's search, retrieval and citation API; ExaUser fetches a page live when a user or an app built on the Exa API asks for its current content. |
| [SofyaBot](https://newruntime.com/readers/sofyabot.md) | Sofya | 876 | Crawler for Sofya's own independent search index (served at search.sofya.co); Sofya sells a web search, fetch and extraction API to AI agents and developers. |
| [ChatGPT-User](https://newruntime.com/readers/chatgpt-user.md) | OpenAI | 812 | Fetches web pages for user-initiated actions in ChatGPT, Custom GPTs and GPT Actions; not an automatic crawler and not used to decide Search eligibility. |
| [ShapBot](https://newruntime.com/readers/shapbot.md) | Parallel Web Systems | 602 | Parallel Web Systems' crawler; it collects publicly available web content to build and maintain Parallel's search index (Parallel sells web search/research APIs for AI agents). A separate Shap-User agent handles user-triggered fetches and does not crawl automatically. |
| [KeenableBot](https://newruntime.com/readers/keenablebot.md) | Keenable | 252 | Builds and maintains the Keenable search index, which answers queries from AI agents and applications and cites source pages with links. A separate Keenable-User agent fetches single pages on behalf of a person or their agent. |
| [Claude-User](https://newruntime.com/readers/claude-user.md) | Anthropic | 118 | Retrieves websites when a Claude user asks a question that requires them (user-initiated fetches). |
| [Claude-SearchBot](https://newruntime.com/readers/claude-searchbot.md) | Anthropic | 43 | Navigates the web to improve the relevance and accuracy of Claude's search results. |
| [Kimi bots](https://newruntime.com/readers/kimi-moonshot.md) | Moonshot AI | 17 | Moonshot AI's Kimi crawlers: KimiBot crawls content potentially used to train Kimi foundation models; Kimi-SearchBot builds the index for Kimi search; Kimi-User fetches pages for user-initiated actions. 'MoonshotBot' is listed only by third-party directories and is not on Moonshot's crawler page. |
| [GrokBot / xAI-SearchBot](https://newruntime.com/readers/xai-grok.md) | xAI (unconfirmed; UA claims x.ai) | 8 | User agents that claim to be xAI (GrokBot/1.0, xAI-SearchBot/1.0 with +https://x.ai). Third-party directories describe xAI-SearchBot as fetching/indexing pages for Grok search and answers; GrokBot's purpose is undisclosed. xAI publishes no crawler documentation. |
| [YouBot](https://newruntime.com/readers/youbot.md) | You.com | 8 | You.com's web crawler that discovers and indexes public pages to return real-time results in You.com's AI search. |
| [DuckAssistBot](https://newruntime.com/readers/duckassistbot.md) | DuckDuckGo | 6 | Crawls pages in real time to supply DuckDuckGo's AI-assisted answers (DuckAssist), which cite their sources. DuckDuckGo states the data is not used to train AI models. |
| [Google-CloudVertexBot](https://newruntime.com/readers/google-cloudvertexbot.md) | Google | 5 | Google crawler that performs crawls requested by site owners to build Vertex AI Agents; Google says it has no effect on Google Search or other products. |
| [cohere-ai](https://newruntime.com/readers/cohere-ai.md) | Cohere | 4 | Undocumented agent with UA 'cohere-ai; +https://cohere.com/crawler'. Secondary sources say it is possibly dispatched by Cohere's AI chat products to fetch content for user prompts; Cohere has not stated its purpose, and cohere.com/crawler returned 404 on 2026-10-23. |
| [Meta-ExternalFetcher](https://newruntime.com/readers/meta-externalfetcher.md) | Meta | 2 | Fetches individual links at a user's request, including for agentic AI tasks in Meta AI products. |

## AI model crawlers

Collect pages for model training or open web datasets, plus the robots.txt control tokens that govern that use.

| Reader | Operator | Requests | Purpose |
| --- | --- | ---: | --- |
| [Meta-ExternalAgent](https://newruntime.com/readers/meta-externalagent.md) | Meta | 7,984 | Meta crawler for use cases such as training foundation AI models or improving products by indexing content directly. |
| [ClaudeBot](https://newruntime.com/readers/claudebot.md) | Anthropic | 3,677 | Anthropic's crawler collecting public web content that may contribute to training its generative AI models. |
| [Reflectionbot](https://newruntime.com/readers/reflectionbot.md) | Reflection AI | 2,345 | Reflection AI's web crawler. It visits publicly available web pages to help build and improve the company's (open) AI models; it is currently the only user agent Reflection AI crawls with. |
| [Amazonbot](https://newruntime.com/readers/amazonbot.md) | Amazon | 2,267 | Amazon crawler used to improve Amazon products and services; Amazon states its data may be used to train Amazon AI models. Related agents: Amzn-SearchBot (search, e.g. Alexa; no AI training) and Amzn-User (live user-request fetches). |
| [GPTBot](https://newruntime.com/readers/gptbot.md) | OpenAI | 2,236 | OpenAI's crawler for content that may be used to train its generative AI foundation models. |
| [Google-Extended](https://newruntime.com/readers/google-extended.md) | Google | 106 | Not a crawler: a standalone robots.txt product token that lets publishers control whether content crawled by Google may be used to train future Gemini models and for grounding in Gemini Apps and Vertex AI. It has no separate HTTP user-agent string; crawling uses existing Google user agents. |
| [Bytespider](https://newruntime.com/readers/bytespider.md) | ByteDance | 29 | ByteDance crawler described by secondary sources as an AI data scraper, allegedly used to build training data for ByteDance LLMs such as Doubao. No operator documentation was opened. |
| [CCBot](https://newruntime.com/readers/ccbot.md) | Common Crawl | 29 | Crawler of the non-profit Common Crawl, which builds an open web archive; the corpus is widely reused, including as AI training data. |
| [DeepSeekBot](https://newruntime.com/readers/deepseekbot.md) | DeepSeek | 15 | Reported as a DeepSeek crawler collecting web content for AI model training (UA 'DeepSeekBot/1.0; +https://www.deepseek.com/bot'). The referenced deepseek.com/bot page returned 404 on 2026-10-23, so there is no confirmed first-party documentation. |
| [ChatGLM-Spider](https://newruntime.com/readers/chatglm-spider.md) | Zhipu AI (unconfirmed; UA claims zhipuai.cn) | 7 | Claims to be Zhipu AI's crawler (UA 'ChatGLM-Spider/1.0; +https://zhipuai.cn/'); third-party directories say it collects data to train and evaluate ChatGLM/GLM models. No Zhipu documentation found. |
| [Qwenbot](https://newruntime.com/readers/qwenbot.md) | Alibaba (unconfirmed; UA claims Qwen) | 7 | Claims to be Alibaba's Qwen crawler (UA 'Qwenbot/1.0; +https://qwen.alibaba.com/'); third-party directories say it collects content for Qwen training and answers. The doc URL they cite (tongyi.aliyun.com/bot) redirects to a 404; no Alibaba documentation found. |
| [Applebot-Extended](https://newruntime.com/readers/applebot-extended.md) | Apple | 5 | Secondary user agent that does not crawl; it only governs whether data already crawled by Applebot may be used to train Apple's foundation models. |
| [YiBot](https://newruntime.com/readers/yibot.md) | 01.AI (unconfirmed; UA claims 01.ai) | 4 | Claims to be 01.AI's crawler (UA 'YiBot/1.0; +https://01.ai/'); a third-party directory describes it as collecting training data. No 01.AI documentation found. |
| [PanguBot](https://newruntime.com/readers/pangubot.md) | Huawei (unconfirmed; UA contact pangubot@huawei.com) | 3 | Claims to be Huawei's crawler (UA 'compatible;PanguBot;pangubot@huawei.com'); directories say it collects training data for Huawei's PanGu models. No Huawei documentation found. |

## Search engines

Index pages for classic web search results.

| Reader | Operator | Requests | Purpose |
| --- | --- | ---: | --- |
| [PetalBot](https://newruntime.com/readers/petalbot.md) | Huawei (Petal Search) | 5,883 | Huawei's crawler for the Petal Search engine; directories also say it supplies content recommendations for Huawei Assistant and other Huawei AI services. It crawls mostly with a mobile user agent that looks like Chrome on Android 7.0 and names itself only at the end ('compatible; PetalBot'). Official page (webmaster.petalsearch.com/site/petalbot) is JS-only and could not be read. |
| [Applebot](https://newruntime.com/readers/applebot.md) | Apple | 4,609 | Apple's web crawler; its data powers search features in Spotlight, Siri and Safari and may supply context for AI-generated answers in Apple products. The separate Applebot-Extended token (no crawling of its own) controls whether crawled data may train Apple's foundation models. |
| [YandexBot](https://newruntime.com/readers/yandexbot.md) | Yandex | 4,397 | Yandex's main indexing robot for the Yandex search engine; Yandex runs many other specialised robots (YandexImages, YandexMobileBot, etc.). |
| [Bingbot](https://newruntime.com/readers/bingbot.md) | Microsoft | 3,126 | Microsoft's main crawler collecting documents for the Bing search index (deployed 2010, successor to msnbot). Bing's index also underlies Copilot and other engines that license Bing results. |
| [Googlebot](https://newruntime.com/readers/googlebot.md) | Google | 1,788 | Generic name for Google Search's smartphone and desktop crawlers that fetch pages for the Google Search index (incl. Discover, Images, Video, News). Gemini training/grounding is controlled separately by the Google-Extended robots token. |
| [Baiduspider](https://newruntime.com/readers/baiduspider.md) | Baidu | 37 | Baidu search engine's crawler that visits web pages to build the index used by Baidu Search; product-specific variants exist for images, video and news. |
| [LohiSoftBot](https://newruntime.com/readers/lohisoftbot.md) | LohiSoft s.r.o. | 27 | Builds LohiSoft's own search index from page titles, meta descriptions, h1-h3 headings, URLs and inbound link text (not page bodies), at most 20 pages per site. The operator states it does not collect AI training data or republish content. |
| [DuckDuckBot](https://newruntime.com/readers/duckduckbot.md) | DuckDuckGo | 10 | DuckDuckGo's web crawler, used to improve DuckDuckGo search results. |
| [SeznamBot](https://newruntime.com/readers/seznambot.md) | Seznam.cz | 10 | Crawler that fetches content for the Seznam.cz (Czech) search engine; a companion FreshBot crawls fresh pages and RSS feeds, mostly news. |
| [Bravebot](https://newruntime.com/readers/bravebot.md) | Brave | 4 | Brave Search's crawler, which discovers and indexes pages for Brave's independent search index (also sold via the Brave Search API and used for Brave's AI answers); partly informed by opt-in Web Discovery Project data from Brave browser users. |
| [Meta-WebIndexer](https://newruntime.com/readers/meta-webindexer.md) | Meta | 2 | Navigates the web to improve Meta AI search result quality; allowing it helps Meta cite and link content in Meta AI responses. |

## Agentic web & MCP registries

Directories, liveness monitors and verifiers for MCP servers, agent cards and machine entry points. The newest and fastest-growing group.

| Reader | Operator | Requests | Purpose |
| --- | --- | ---: | --- |
| [mcpbeat](https://newruntime.com/readers/mcpbeat.md) | mcpbeat (theevoq) | 3,075 | Independent monitor of public MCP servers. Every 15 minutes it sends an MCP initialize handshake followed by tools/list, resources/list and prompts/list (never tools/call, never authenticates), and it also reviews registry, npm/PyPI and source metadata; results feed public uptime and ranking pages. |
| [rokmcp-collector](https://newruntime.com/readers/rokmcp-collector.md) | unknown | 591 | Self-described in its user-agent as "rokmcp-collector/0.2", an MCP-related collector; rokmcp.com exists but returned HTTP 503 and no description could be retrieved. No operator page or public documentation could be found as of 2026-10-23. |
| [agent-tools.cloud crawler](https://newruntime.com/readers/agent-tools-cloud-crawler.md) | agent-tools.cloud | 395 | Crawler for agent-tools.cloud, an open discovery directory of x402 paid APIs, remote MCP servers and A2A agents. Per its about page it runs initialize + tools/list conformance checks on MCP servers, fetches and parses A2A agent cards, and re-probes availability daily. |
| [BrickBlueBot](https://newruntime.com/readers/brickbluebot.md) | brick.blue | 355 | Crawler for brick.blue's registry of agents and tools. It reads DNS TXT (_agent/_mcp), .well-known agent/MCP cards, llms.txt, openapi.json and agents.json, runs MCP initialize and tools/list (plus up to three no-argument tools/call on read-only-looking tools), and reads x402 402 responses without paying. |
| [OraBot](https://newruntime.com/readers/orabot.md) | Ora | 164 | Ora's on-demand scanner that scores how ready a website is for AI agents. When someone requests a score for a domain it fetches robots.txt, llms.txt, OpenAPI specs, MCP manifests, structured data and /.well-known/poppy.json in a bounded burst; during a scan it also requests the homepage under other crawlers' UAs (GPTBot, ClaudeBot, PerplexityBot). |
| [GolemreachTrustBot](https://newruntime.com/readers/golemreachtrustbot.md) | Golemreach | 160 | Outside-in trust prober for remote MCP servers listed in the official MCP registry: one GET, one initialize and one tools/list per endpoint at most every 6 hours (never calls tools or sends credentials), plus fetching A2A agent cards; results are published at golemreach.com/trust. |
| [WellknownBot](https://newruntime.com/readers/wellknownbot.md) | unknown | 104 | Self-described in its user-agent as "WellknownBot/0.1" with listing and claim URLs, i.e. a directory crawler that creates a listing for the site and offers a claim link. No operator page or public documentation could be found as of 2026-10-23. |
| [TalandorBot](https://newruntime.com/readers/talandorbot.md) | Talandor | 96 | Likely the checker behind Talandor, an MCP server checker and monitoring tool that indexes Official MCP Registry entries, negotiates protocol versions and reads public tools/list results without calling tools. Talandor's pages do not document the TalandorBot user-agent. |
| [AgenstryBot](https://newruntime.com/readers/agenstrybot.md) | Agenstry | 73 | Crawler for Agenstry, an AI agent directory for A2A and MCP that publishes measured evidence about public agent infrastructure. It fetches .well-known A2A cards and MCP manifests, sitemaps and metadata, may send a JSON-RPC ping or MCP initialize/tools/list, and rechecks live agents roughly hourly. |
| [7Maps-bot](https://newruntime.com/readers/7maps-bot.md) | 7IT (7IT Solutions) | 56 | Crawler behind 7Maps, a live map of public MCP servers. It visits servers listed in public MCP registries and sends only initialize and tools/list (plus a daily server/discover), never calling tools; it publishes reachability, latency, tool counts and an estimated per-tool risk level. |
| [histor](https://newruntime.com/readers/histor.md) | unknown | 21 | Self-described in its user-agent as "histor/0.1.0" making read-only MCP probes (initialize + tools/list only). No operator page or public documentation could be found as of 2026-10-23. |
| [KnownGood-Verifier](https://newruntime.com/readers/knowngood-verifier.md) | unknown | 20 | Self-described in its user-agent as "KnownGood-Verifier/0.3", a verification bot (by name, verifying known-good endpoints). No operator page or public documentation could be found as of 2026-10-23. |
| [MCPHereBot](https://newruntime.com/readers/mcpherebot.md) | unknown | 15 | Self-described in its user-agent as "MCPHereBot/1.0", an MCP-focused bot. No operator page or public documentation could be found as of 2026-10-23. |
| [StealthStackCrawler](https://newruntime.com/readers/stealthstackcrawler.md) | StealthStack | 13 | Crawler for StealthStack, 'the index of the agentic web', which crawls Agentic Resource Discovery (ARD) catalogs and indexes the skills, MCP servers, A2A agents and catalogs they publish (about 48.9k resources from 4.8k domains as of 2026-10-22). It identifies itself with did:web:stealthstack.ai, whose DID document resolves at stealthstack.ai. |
| [GlintbaseResearch](https://newruntime.com/readers/glintbaseresearch.md) | Glintbase | 9 | Research agent of Glintbase, an applied AI research lab building agent-readiness infrastructure (Agent Readiness Standard, scanner). Its research page describes fetching sites 'as a declared research agent' for agent-readiness studies; no crawler documentation is published. The UA's contact address (research@glintbase.dev) ties it to Glintbase. |
| [AgentTrustBot](https://newruntime.com/readers/agenttrustbot.md) | agenttru.st | 6 | Crawler for the agenttru.st directory of AI agents. It discovers hostnames from public Certificate Transparency logs and checks well-known discovery paths (agent cards, MCP server cards) and DNS records (ANS, DNS-AID) for published agents, plus icon fetches and re-checks of listed agents. Formerly AgentTrust-Collector. |
| [GAIP-Observatory](https://newruntime.com/readers/gaip-observatory.md) | GAIP (gaipagents.com) | 6 | The GAIP Agent Observatory records dated, observed facts about public MCP servers and A2A agent cards, checking each at most once a day and keeping a hash-chained history of manifests and changes. It reads agent cards, registry server.json and the MCP discovery handshake (initialize, tools/list, resources/list); it never calls tools or authenticates and gives no scores. |
| [MCPStationBot](https://newruntime.com/readers/mcpstationbot.md) | Protocol Holdings Co., Ltd. (MCP Station) | 6 | Checker for MCP Station, which lists remote MCP servers published in the Official MCP Registry and checks each daily for reachability, required authentication, MCP version and offered tools. |
| [x402-router-crawler](https://newruntime.com/readers/x402-router-crawler.md) | unknown | 6 | Self-described in its user-agent as "x402-router-crawler/4.0", a crawler for an x402 payment-routing service. No operator page or public documentation could be found as of 2026-10-23. |
| [AgentIndexBot](https://newruntime.com/readers/agentindexbot.md) | unknown | 4 | Self-described in its user-agent as "AgentIndexBot/0.1", a 'polite ARD crawler' (Agentic Resource Discovery catalogs). No operator page or public documentation could be found as of 2026-10-23. |
| [mcpcensusbot](https://newruntime.com/readers/mcpcensusbot.md) | The MCP Census | 4 | Crawler for The MCP Census, a service for checking MCP servers before install. When a search finds no census hit for a brand, it looks for an off-registry server with GET /.well-known/mcp.json, GET /.well-known/mcp-registry-auth and a DoH lookup for mcp.<domain>; GET only, results cached 7–30 days. |

## SEO & backlink crawlers

Build link graphs and page databases for SEO platforms.

| Reader | Operator | Requests | Purpose |
| --- | --- | ---: | --- |
| [AhrefsBot](https://newruntime.com/readers/ahrefsbot.md) | Ahrefs | 13,472 | Ahrefs' crawler that builds the link/page database behind the Ahrefs SEO platform and the Yep search engine. A separate AhrefsSiteAudit agent runs site audits. |
| [SemrushBot](https://newruntime.com/readers/semrushbot.md) | Semrush | 9,333 | Semrush's crawler that discovers links and revisits pages for its Backlink Analytics index and many tools (Site Audit, Backlink Audit, writing/plagiarism checks, etc.). |
| [MJ12bot](https://newruntime.com/readers/mj12bot.md) | Majestic | 4,177 | Majestic's distributed crawler that maps link relationships between websites for the Majestic Site Explorer backlink index; it does not cache page content. |
| [DataForSeoBot](https://newruntime.com/readers/dataforseobot.md) | DataForSEO | 2,638 | DataForSEO's backlink-checker crawler; adds newly found links to its backlink database and rechecks existing ones, which is resold via API to SEO tools. |
| [serpstatbot](https://newruntime.com/readers/serpstatbot.md) | Serpstat | 1,152 | Serpstat's crawler that discovers new links and tracks changes for the Serpstat backlink index. |
| [DotBot](https://newruntime.com/readers/dotbot.md) | Moz | 338 | Moz's web crawler that gathers link and site data for Moz's link index and SEO tools (UA references opensiteexplorer.org/dotbot). |
| [SERankingBacklinksBot](https://newruntime.com/readers/serankingbacklinksbot.md) | SE Ranking | 315 | SE Ranking's crawler for its backlink database used in the SE Ranking SEO platform. |
| [Barkrowler](https://newruntime.com/readers/barkrowler.md) | Babbar | 61 | Babbar's crawler that builds a graph of the public web (links and page metadata, not content) to power SEO and online-marketing metrics. |
| [CrawlCheck](https://newruntime.com/readers/crawlcheck.md) | CrawlCheck (crawlcheck.io) | 12 | Free site audit that checks whether AI and search crawlers can read a site. The CrawlCheck/1.0 UA fetches machine files and control paths (robots.txt, sitemaps, llms.txt, API catalog); the homepage is additionally requested once under ~12 other crawler identities (GPTBot, ClaudeBot, Googlebot, etc.). |
| [AgentReadyBot](https://newruntime.com/readers/agentreadybot.md) | Robots Drinking Tea LLC | 10 | On-demand AI-readiness scanner: when someone requests a report it reads up to 25 pages plus robots.txt and the homepage, compares what humans and machines get, and sends test requests with seven AI crawler names to see whether the site blocks them. |
| [Screaming Frog SEO Spider](https://newruntime.com/readers/screaming-frog-seo-spider.md) | Screaming Frog | 2 | Desktop SEO crawler run by individual users (agencies, site owners) to audit sites on demand; not a central index. |

## Link previewers

Fetch a page once when someone shares its link in a chat or social app, to draw the preview card.

| Reader | Operator | Requests | Purpose |
| --- | --- | ---: | --- |
| [facebookexternalhit](https://newruntime.com/readers/facebookexternalhit.md) | Meta | 1,538 | Meta's fetcher that retrieves pages shared on Facebook, Instagram or Messenger to build and cache link previews (title, description, thumbnail). |
| [TelegramBot](https://newruntime.com/readers/telegrambot.md) | Telegram | 70 | Telegram's fetcher that retrieves a shared URL to build link previews (and Instant View) in Telegram chats and channels. |
| [Twitterbot](https://newruntime.com/readers/twitterbot.md) | X Corp. | 40 | X's fetcher that retrieves card metadata (Twitter Cards / Open Graph) to render link previews when a URL is shared on X. |
| [LinkedInBot](https://newruntime.com/readers/linkedinbot.md) | LinkedIn | 39 | LinkedIn's fetcher that retrieves Open Graph metadata and images to build link previews when URLs are shared on LinkedIn. |
| [Slackbot](https://newruntime.com/readers/slackbot.md) | Slack (Salesforce) | 37 | Slack's link-expanding fetcher that reads oEmbed/Open Graph/Twitter Card tags (partial Range fetch) when a user posts a link in Slack; caches about 30 minutes. |
| [WhatsApp](https://newruntime.com/readers/whatsapp.md) | Meta (WhatsApp) | 31 | WhatsApp's fetcher that GETs a shared page to build a link preview from Open Graph tags; UA is WhatsApp/2.x.x.x with A/I/N platform suffix. |
| [Discordbot](https://newruntime.com/readers/discordbot.md) | Discord | 18 | Discord's fetcher that visits a link shared in a Discord message to grab title, description and image for an embed; it does not crawl on its own. |

## Scanners & probes

Internet-wide security scanners and probes. Excluded from the observatory's reader totals.

| Reader | Operator | Requests | Purpose |
| --- | --- | ---: | --- |
| [CensysInspect](https://newruntime.com/readers/censysinspect.md) | Censys | 779 | Censys's internet-wide scanner; HTTP scans identify as CensysInspect and collect service information for the Censys search/attack-surface dataset without attempting authentication. |
| [zgrab](https://newruntime.com/readers/zgrab.md) | unknown | 638 | ZGrab/ZGrab2 is an open-source application-layer scanner from the ZMap project for Internet-wide surveys; its default UA (e.g. 'Mozilla/5.0 zgrab/0.x') is sent by academics, scan indexers and attackers alike. |
| [Infrawatch](https://newruntime.com/readers/infrawatch.md) | Infrawatch Limited | 195 | UK internet-measurement and security-research scanner that routinely observes publicly exposed hosts and services; says it does not exploit or brute-force. |
| [ModatScanner](https://newruntime.com/readers/modatscanner.md) | Modat | 53 | Modat's internet-wide scanner that indexes hosts at the machine level for its Internet search product; scanning only, no intrusion. |
| [CyberConvoyScout](https://newruntime.com/readers/cyberconvoyscout.md) | CyberConvoy | 43 | Internet-wide scanner (single SYN probes and light banner grabs on a few ports) collecting banners, HTTP headers and TLS certificates for threat intelligence, per a third-party catalog. |
| [GenomeCrawlerd](https://newruntime.com/readers/genomecrawlerd.md) | Nokia (Deepfield) | 17 | Crawler for Nokia Deepfield Secure Genome, a 'security map' of the internet used for traffic analysis and DDoS detection/mitigation in Nokia Deepfield Defender. It systematically crawls the IPv4 and active IPv6 address spaces on specific ports to identify the services hosts provide. |
| [GoScanner](https://newruntime.com/readers/goscanner.md) | unknown | 8 | Unidentified scanner UA seen in our logs; no public documentation found for this name. |
| [Shodan](https://newruntime.com/readers/shodan.md) | Shodan | 4 | Search engine for Internet-connected devices; its crawlers continuously query hosts and collect service banners for the Shodan index. |
| [OAI-AdsBot](https://newruntime.com/readers/oai-adsbot.md) | OpenAI | 2 | Validates the safety of landing pages submitted as ads on ChatGPT; only visits pages submitted as ads and its data is not used for model training. |

## Unidentified

Clients with no product name. We describe only what they did.

| Reader | Operator | Requests | Purpose |
| --- | --- | ---: | --- |
| [Unnamed Linux-Chrome automation](https://newruntime.com/readers/unidentified-linux-chrome.md) | unknown | 1,025 | Clients presenting a desktop Chrome on Linux user agent that the observatory classifies as automation rather than a human browser. No product name, operator or documentation is visible in the published label. |
| [DocSpider](https://newruntime.com/readers/docspider.md) | unknown | 21 | Self-described in its user-agent as "Mozilla/5.0 (compatible; DocSpider/0.1; +URL)"; no public documentation or operator found (not the same as DocSpotBot). |
| [IntentRouteBot](https://newruntime.com/readers/intentroutebot.md) | unknown | 10 | Self-described in its user-agent as "IntentRouteBot/0.1 (+URL)"; no public documentation or operator found. |
| [ZeroBot](https://newruntime.com/readers/zerobot.md) | unknown | 8 | Self-described in its user-agent as "Mozilla/5.0 (compatible; ZeroBot/1.0; +URL)"; no public crawler documentation found (unrelated to the ZeroBot bot-protection vendor or ZumBot). |