ChatGPT, Claude, Perplexity and friends now send real people to websites, and their crawlers visit before they do. The new AI crawlers card shows which providers fetch your pages and why: answering a user live, building a search index, or collecting training data.
We also published a directory of the AI crawlers we recognise, with their user agents and what they do.