Skip to content
Free, unlimited

Is that really an AI crawler?

Paste a log line and find out whether that crawler really was who it claimed to be.

Free, no signup. Checks the address against the operator's own published ranges, then falls back to forward-confirmed reverse DNS.

If it was not who it claimed

A forged user-agent tells you nothing about access, which is the question underneath it.

  1. 01See which crawlers you actually allow
  2. 02Check the page a real crawler gets
  3. 03Run every check on one shareable page

Common questions

More free tools

Check whether they are allowed in at all

Verification tells you a request was genuine. Whether your robots.txt lets that crawler read the page is a separate question, and the two are often confused.