Baseline Labs wiki / Bot
Diffbot
Bot in AI search and SEO
Stub
The structured-extraction crawler behind the Diffbot Knowledge Graph API. It parses pages into structured records and sells that data to companies, including AI developers. Compliance is documented as discretionary depending on the product.
Verification
Operator documentation: https://docs.diffbot.com/docs/diffbot-crawl-bot
A user agent is a claim, not a proof: any client can send any name. Where an operator publishes IP ranges, a reverse lookup is the only way to tell a real visit from an impersonation.
Seen by Baseline
Requests, 30 days
...
Last 7 days
...
First seen
...
Last seen
...
Requests from this bot across sites tracked by Baseline, last 30 days. Aggregated over - sites, never reported per site.
Last updated 2026-09-04. Written and maintained by Baseline Labs.
