AI crawlers
AI crawlers
Your JS tracker sees humans arriving from AI. Server logs see the AI bots themselves. Paste or upload a slice of your access log - we parse it in memory and never store it.
Sign in to read your log
Parsing costs nothing and we store none of it, but the parser runs against your account. Creating one is free and takes no card.
Up to 10 MB. Combined/common log format, Caddy JSON lines, or most vhost-prefixed variants.
Add your domain to see whether crawlers respect your robots.txt - we fetch it live, never cached.
Processed in memory. Never stored.
AI bot visits
-
AI bots
-
Pages crawled
-
Policy conflicts
-
Declared vs observed
Hits by bot
Top crawled paths
Other bot-like agents
Not in our AI registry - tell us if one of these matters.
