OAI-SearchBot
by OpenAI
Search indexes · Discovery
Indexes websites so they can appear and be linked in ChatGPT search results.
Not used for training. Blocking it can remove your pages from ChatGPT search answers.
Crawlers that build the search indexes used by search engines and AI search features.
Control it with robots.txt
Well-behaved crawlers read robots.txt before crawling. To block OAI-SearchBot on your whole site:
robots.txt
User-agent: OAI-SearchBot Disallow: /
Blocking AI search and answer crawlers can also remove your pages from AI answers and citations. Weigh traffic from AI assistants before blocking them. Official documentation: platform.openai.com.