SEO & backlink crawlers

AhrefsBot

Ahrefs' crawler that builds the link/page database behind the Ahrefs SEO platform and the Yep search engine. A separate AhrefsSiteAudit agent runs site audits.

Dossier

Operator: Ahrefs
Documentation: ahrefs.com
robots.txt token: AhrefsBotAhrefsSiteAudit
Feeds: SEO backlink index, search index
Follows robots.txt: Yes, per its documentationDocs: honors robots.txt incl. crawl-delay; verified owners can let Site Audit ignore it on their own sites.
How to verify: Published IP ranges and reverse DNSapi.ahrefs.com
Names in our logs: ahrefsbot
Researched: 23 Oct 2026

Observed on New Runtime

Baseline 2026-10-23 · 93-day window · loading live numbers…

Requests: 13,472
Days active: 89 / 93
First seen: 24 Jul 2026
Last seen: 23 Oct 2026

Regularother_bot

Daily requests across the observed window, square-root scale.

Identity check claimed vs verified

not verifiable6,110 reqprovider not published

What it reads crawler journeys · current window

Content pages5,846
Feeds & discovery32
Machine-consumption3

1,742 unique materials · 479 canonical pages

Sources

ahrefs.comahrefs.com/robot