SemrushBot-OCOB
The Semrush crawler serving ContentShake, its AI writing tool. Included because its fetches feed AI content generation, though Semrush is an SEO platform rather than a lab.
What it feeds
SemrushBot-OCOB is the fetch behind Semrush's AI writing tool rather than its backlink index. It sits in this registry because the pages it reads feed AI content generation, not because Semrush is a model lab.
How to identify it
Semrush asks that the bot be managed by token rather than by address, and states that it uses no consecutive IP blocks.[1] That rules out a firewall range rule and leaves robots.txt as the intended control.
Crawl rate
Verification
Operator documentation: https://www.semrush.com/bot/
A user agent is a claim, not a proof: any client can send any name. Where an operator publishes IP ranges, a reverse lookup is the only way to tell a real visit from an impersonation.
Seen by Baseline
Requests from this bot across sites tracked by Baseline, last 30 days. Aggregated over - sites, never reported per site.
Last updated 2026-09-05. Written and maintained by Baseline Labs.