Claude-User
by Anthropic
AI answers · User-triggered
Fetches a page when a Claude user asks a question that needs it.
An assistant fetches your page live because a person asked a question. These visits can turn into real traffic through citations.
Control it with robots.txt
Well-behaved crawlers read robots.txt before crawling. To block Claude-User on your whole site:
robots.txt
User-agent: Claude-User Disallow: /
Blocking AI search and answer crawlers can also remove your pages from AI answers and citations. Weigh traffic from AI assistants before blocking them.