Baseline Labs wiki / Bot
AI2Bot
Bot in AI search and SEO
Stub
The Allen Institute for AI crawler, collecting data for open language models such as OLMo and the Dolma corpus. A rare case where the training data, the models and the crawler policy are all published openly.
Verification
Operator documentation: https://allenai.org/crawler
A user agent is a claim, not a proof: any client can send any name. Where an operator publishes IP ranges, a reverse lookup is the only way to tell a real visit from an impersonation.
Seen by Baseline
Requests, 30 days
...
Last 7 days
...
First seen
...
Last seen
...
Requests from this bot across sites tracked by Baseline, last 30 days. Aggregated over - sites, never reported per site.
Last updated 2026-09-04. Written and maintained by Baseline Labs.
