Skip to content
AI crawler access

prodregistryv2.org allows every AI crawler we checked

All 10 AI crawlers we checked are permitted by prodregistryv2.org's robots.txt. Checked 2026-08-07.

AI crawlers disallowed in robots.txt
0
of 10 checked

Nothing is blocked

prodregistryv2.org's robots.txt permits all 10 agents. Whether an assistant chooses to cite it is a separate question this check does not answer.

Permitted

GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, Claude-SearchBot, PerplexityBot, Perplexity-User, Google-Extended, Googlebot

What this does and does not show

Method. One request to prodregistryv2.org/robots.txt on 2026-08-07, parsed for Disallow rules applying to each of the 10 named agents. No JavaScript, no login, nothing that cannot be reproduced with curl in a few seconds.

This is a snapshot. robots.txt changes whenever the site owner edits it, and this page reports one day. Anyone can re-run the same check live, and if it disagrees with what is here, the live result is the true one.

Access is not citation. A permitted crawler may never fetch the page, and a fetched page may never be quoted. Equally, a blocked crawler does not make a site invisible: content an engine learned before a rule was added does not disappear, and other sites writing about prodregistryv2.org remain readable.

Check your own site

The same check runs on any domain, free and without an account. It reports training and search crawlers separately, because collapsing them is the mistake this page exists to correct.