GPTBot
by OpenAI
Training crawlers · Model data
Crawls public pages that may be used to train OpenAI's generative AI models.
Disallowing GPTBot doesn't affect ChatGPT search (OAI-SearchBot) or user fetches (ChatGPT-User).
Crawlers (or robots.txt controls) that collect public content used to train AI models.
Control it with robots.txt
Well-behaved crawlers read robots.txt before crawling. To block GPTBot on your whole site:
robots.txt
User-agent: GPTBot Disallow: /
Blocking AI search and answer crawlers can also remove your pages from AI answers and citations. Weigh traffic from AI assistants before blocking them. Official documentation: platform.openai.com.