SEO & backlink crawlers
SemrushBot
Semrush's crawler that discovers links and revisits pages for its Backlink Analytics index and many tools (Site Audit, Backlink Audit, writing/plagiarism checks, etc.).
Dossier
- Operator
- Semrush
- Documentation
- semrush.com
- robots.txt token
SemrushBotSiteAuditBotSemrushBot-BASemrushBot-SISemrushBot-SWASplitSignalBotSemrushBot-OCOBSemrushBot-FTRyteBotSemrushBot-ESI- Feeds
- SEO backlink index
- Follows robots.txt
- Yes, per its documentationDocs: per-tool tokens, Disallow and Crawl-delay (capped at 10 s) supported.
- How to verify
- No published method
- Names in our logs
semrushbot- Researched
- 23 Oct 2026
Observed on New Runtime
Baseline 2026-10-23 · 93-day window · loading live numbers…
- Requests
- 9,333
- Days active
- 84 / 93
- First seen
- 26 Jul 2026
- Last seen
- 23 Oct 2026
Regularother_bot
Identity check claimed vs verified
- not verifiable1,755 reqprovider not published
What it reads crawler journeys · current window
- Content pages1,580
- Feeds & discovery60
- Machine-consumption0
904 unique materials · 634 canonical pages
Enters at · 7 days
Leaves from · 7 days
Sources
- semrush.comwww.semrush.com/bot/