What is GPTBot?

GPTBot is OpenAI's web crawler. It reads pages to train and ground OpenAI's models, including ChatGPT.

It is one of several OpenAI agents. OAI-SearchBot builds ChatGPT's search index, and ChatGPT-User fetches a page live when a user's question requires it. Blocking one does not block the others.

Blocking GPTBot has no effect on Google Search ranking, because it is a different company's crawler. The agent people confuse it with is Google-Extended, which controls Gemini grounding and training and also does not affect Google Search.

robots.txtrobots.txt is a file at a site's root that tells crawlers which parts of the site they may fetch. It is a request, not an enforcement mechanism.
AI crawlerAn AI crawler is a bot operated by an AI company to fetch web pages for training, indexing, or answering a live question.

Want to know where you actually stand on this? Run a free visibility check or try the free tools.

What is GPTBot?

Related