omgilibot

The token belongs to Webz.io, which crawls forums, reviews and news into datasets it sells on. The omgili name is the older one and is what still shows up in server logs.^[1] Material gathered this way is tagged for whether it may be used in AI and machine learning training.^[2]

Webz.io states that its crawlers honour robots.txt exclusions.^[3] Because the output is a dataset sold to third parties rather than a live answer engine, blocking costs no citations: it removes the site from a training and research corpus.^[4]

Omgili began as a forum search engine and the crawler kept its name after Webz.io took over the data business, which is why a modern log line can carry a token whose brand no longer exists.^[1] The current pairing splits the work between a collector and Webzio-Extended, which does the permission tagging.^[2]

Operator documentation: https://webz.io/bot.html

A user agent is a claim, not a proof: any client can send any name. Where an operator publishes IP ranges, a reverse lookup is the only way to tell a real visit from an impersonation.