Baseline Labs wiki / Bot
Bytespider
Bot in AI search and SEO
Stub
The ByteDance training crawler, gathering data for its LLM efforts including Doubao. Notorious for two things: extremely aggressive crawl volume, and widespread independent reports that it ignores robots.txt entirely. The bot most often named in server-load complaints.
Verification
There is no documentation page or IP range list from ByteDance that we can point at for this token.
A user agent is a claim, not a proof: any client can send any name. Where an operator publishes IP ranges, a reverse lookup is the only way to tell a real visit from an impersonation.
Seen by Baseline
Requests, 30 days
...
Last 7 days
...
First seen
...
Last seen
...
Requests from this bot across sites tracked by Baseline, last 30 days. Aggregated over - sites, never reported per site.
Last updated 2026-09-04. Written and maintained by Baseline Labs.
