Skip to content

SemrushBot-OCOB

Bot in AI search and SEO
Moving Some facts here change over months and are rechecked monthly.

The Semrush crawler serving ContentShake, its AI writing tool. Included because its fetches feed AI content generation, though Semrush is an SEO platform rather than a lab.

What it feeds

SemrushBot-OCOB is the fetch behind Semrush's AI writing tool rather than its backlink index. It sits in this registry because the pages it reads feed AI content generation, not because Semrush is a model lab.

How to identify it

Semrush asks that the bot be managed by token rather than by address, and states that it uses no consecutive IP blocks.[1] That rules out a firewall range rule and leaves robots.txt as the intended control.

Crawl rate

Semrush documents intervals of up to ten seconds between requests to a site.[2] Where no crawl-delay is set, it says the crawler adapts its request frequency to the server load it observes.[3]

Verification

Operator documentation: https://www.semrush.com/bot/

A user agent is a claim, not a proof: any client can send any name. Where an operator publishes IP ranges, a reverse lookup is the only way to tell a real visit from an impersonation.

Seen by Baseline

Requests, 30 days
...
Last 7 days
...
First seen
...
Last seen
...

Requests from this bot across sites tracked by Baseline, last 30 days. Aggregated over - sites, never reported per site.

References (3)
  1. Semrush, SemrushBot
    Documentation Retrieved 2026-09-05
  2. Semrush, SemrushBot
    Documentation Retrieved 2026-09-05
  3. Semrush, SemrushBot
    Documentation Retrieved 2026-09-05

Last updated 2026-09-05. Written and maintained by Baseline Labs.

George
Online
0%