omgili

The token omgili is the robots.txt name for the Webz.io collection pipeline, kept from the crawler's earlier identity.^[1] The pages it gathers end up in datasets sold for research and for AI training, with a permission tag attached.^[2]

Webz.io states that its crawlers adhere to robots.txt exclusions, so the token is worth writing out in full alongside omgilibot.^[3] The company also says it only supplies data marked as permitted for AI use.^[4]

There is no documentation page or IP range list from Webz.io that we can point at for this token.

A user agent is a claim, not a proof: any client can send any name. Where an operator publishes IP ranges, a reverse lookup is the only way to tell a real visit from an impersonation.