Bot traffic and AI crawlers
Your analytics should count people. DataEasy filters automated traffic at two levels, and tracks AI crawlers separately.
Bots are excluded from analytics
- In the browser, the script doesn't send anything when it detects automation (
navigator.webdriver, headless Chrome, Puppeteer, Playwright, Selenium, Lighthouse…). - On the server, events whose user agent matches a known crawler, link preview, uptime monitor or HTTP library are dropped (accepted with 202 but not stored).
AI crawlers
AI crawlers (GPTBot, ClaudeBot, PerplexityBot…) usually don't execute JavaScript, so a client-side script can't see them. The AI crawlers card of your dashboard groups crawler hits by category:
| Category | Meaning |
|---|---|
| AI answers | A person asked an assistant something and it fetched your page live (e.g. ChatGPT-User). |
| Indexing | Search crawlers building an AI search index (e.g. OAI-SearchBot). |
| Training | Crawlers collecting data to train models (e.g. GPTBot, CCBot). |
Server-side crawler reporting (a small middleware for Next.js, Express and Cloudflare) is coming soon. Browse the AI crawler directory to see which bots we recognise.