Baseline Labs wiki / Bot
Crawl4AI
Bot in AI search and SEO
Stub
The default signature of Crawl4AI, an open-source crawling library aimed at LLM data pipelines. Not one operator but thousands of independent users of the same tool.
Verification
There is no documentation page or IP range list from Crawl4AI that we can point at for this token.
A user agent is a claim, not a proof: any client can send any name. Where an operator publishes IP ranges, a reverse lookup is the only way to tell a real visit from an impersonation.
Seen by Baseline
Requests, 30 days
...
Last 7 days
...
First seen
...
Last seen
...
Requests from this bot across sites tracked by Baseline, last 30 days. Aggregated over - sites, never reported per site.
Last updated 2026-09-04. Written and maintained by Baseline Labs.
