DuckDuckBot

by DuckDuckGo

Search indexes · Discovery

DuckDuckGo's search crawler, used to improve its search results.

Crawlers that build the search indexes used by search engines and AI search features.

Control it with robots.txt

Well-behaved crawlers read robots.txt before crawling. To block DuckDuckBot on your whole site:

robots.txt
User-agent: DuckDuckBot
Disallow: /

Blocking AI search and answer crawlers can also remove your pages from AI answers and citations. Weigh traffic from AI assistants before blocking them.

Other DuckDuckGo crawlers