> ## Documentation Index
> Fetch the complete documentation index at: https://docs.usequotable.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Agent Analytics

> See which AI crawlers and assistants request your pages, whether those requests are verified, and where they fail, from your own server-side logs.

> [!NOTE]
>
> **Plans:** All plans, [limits](https://docs.usequotable.com/workspace/plans-and-limits.md#brand-plans) vary · **In the app:** Sidebar → Analytics → Agent Analytics

Agent Analytics shows how AI systems reach your website. You connect the request logs your CDN, host or server already produces, and Quotable picks out the requests made by AI agents: training crawlers like GPTBot, search indexers like OAI-SearchBot and PerplexityBot, and assistants fetching a page for a live user, like ChatGPT-User or Claude-User.

Collection is server-side. There is no JavaScript tag to install, and AI agents rarely run JavaScript anyway, so a client-side tracker would miss them.

## What you can answer with it

* **Who is visiting.** Requests per AI provider and per agent, with the share that is verified.
* **Why they visit.** Each agent is labelled with its purpose: training, search indexing, or fetching for a user.
* **What they read.** The pages AI agents request most, with request counts, distinct agents, errors and p95 response time per page.
* **Where they fail.** URLs that return 4xx or 5xx to AI agents, and slow responses.
* **Whether you allow them.** An on-demand robots.txt audit that shows which AI agents your current rules allow at the site root.
* **What is happening right now.** A live feed of the latest accepted agent requests.

> [!NOTE]
>
> Agent Analytics measures **crawler and agent requests**. Human visitors who click through from an AI answer are a different dataset: see [AI Referrals](https://docs.usequotable.com/agent-analytics/ai-referrals.md). A crawler request does not imply a citation, and a citation does not imply a crawl.

## How it works

**1. You connect a log source**

Pick the platform that serves your site (Cloudflare, Vercel, CloudFront, Fastly, Akamai, Netlify, Google Cloud CDN, or a custom HTTP sender) and point its log delivery at the endpoint URL Quotable gives you. Each source is bound to one domain and has its own token.

**2. Quotable keeps only AI agent requests**

Every delivered record is checked against the agent registry. Human traffic is dropped on arrival and never stored or counted against your quota.

**3. Each agent request is verified**

When the record carries the client IP, Quotable checks it against the provider's published IP ranges or confirms it with reverse DNS. The IP is used for that check only and is then discarded.

**4. You read the results**

The Agent Analytics page of each brand shows KPIs, trends, agents, pages, crawlability checks and live traffic.

## Recognized AI agents

Detection matches the user agent the request declares. The current registry recognizes these agents:

| Agent | Provider | Intent | Verification method |
| - | - | - | - |
| GPTBot | OpenAI | Training | Published IP ranges |
| OAI-SearchBot | OpenAI | Search / index | Published IP ranges |
| ChatGPT-User | OpenAI | User query / retrieval | Published IP ranges |
| OAI-AdsBot | OpenAI | Other / unknown | Published IP ranges |
| ClaudeBot | Anthropic | Training | IP ranges maintained by Quotable |
| Claude-SearchBot | Anthropic | Search / index | IP ranges maintained by Quotable |
| Claude-User | Anthropic | User query / retrieval | IP ranges maintained by Quotable |
| Claude-Agent | Anthropic | Agent / action | Not supported yet |
| PerplexityBot | Perplexity | Search / index | Published IP ranges |
| Perplexity-User | Perplexity | User query / retrieval | Published IP ranges |
| Googlebot | Google | Search / index | Published IP ranges, reverse DNS (googlebot.com, google.com) |
| Googlebot-Image | Google | Search / index | Published IP ranges, reverse DNS (googlebot.com) |
| Googlebot-Video | Google | Search / index | Published IP ranges, reverse DNS (googlebot.com) |
| Storebot-Google | Google | Search / index | Published IP ranges, reverse DNS (googlebot.com) |
| GoogleOther | Google | Other / unknown | Published IP ranges, reverse DNS (googlebot.com) |
| Google-CloudVertexBot | Google | Search / index | Published IP ranges, reverse DNS (googlebot.com) |
| Google-GeminiNotebook | Google | User query / retrieval | Not supported yet |
| Google-Agent | Google | Agent / action | Published IP ranges |
| Bingbot | Microsoft | Search / index | Published IP ranges, reverse DNS (search.msn.com) |
| AdIdxBot | Microsoft | Other / unknown | None available |
| MicrosoftPreview | Microsoft | Other / unknown | None available |
| Applebot | Apple | Search / index | Reverse DNS (applebot.apple.com) |
| Applebot-Extended | Apple | Training | Reverse DNS (applebot.apple.com) |
| Amazonbot | Amazon | Search / index | Reverse DNS (crawl.amazonbot.amazon) |
| Amzn-SearchBot | Amazon | Search / index | Not supported yet |
| Amzn-User | Amazon | User query / retrieval | Not supported yet |
| meta-externalagent | Meta | Training | None available |
| Meta-ExternalFetcher | Meta | User query / retrieval | None available |
| Meta-WebIndexer | Meta | Search / index | None available |
| MistralAI-User | Mistral | User query / retrieval | None available |
| MistralAI-Index | Mistral | Search / index | Published IP ranges |
| MistralAI-Training | Mistral | Training | None available |
| DuckAssistBot | DuckDuckGo | User query / retrieval | IP ranges maintained by Quotable |
| DuckDuckBot | DuckDuckGo | Search / index | Published IP ranges |
| YouBot | You.com | Search / index | Reverse DNS (search.you.com) |
| Kagibot | Kagi | Search / index | Not supported yet |
| ExaSearchBot | Exa | Search / index | Not supported yet |
| ExaUser | Exa | User query / retrieval | Not supported yet |
| Diffbot | Diffbot | Search / index | None available |
| Diffbot-User | Diffbot | User query / retrieval | None available |
| CCBot | Common Crawl | Other / unknown | Published IP ranges, reverse DNS (crawl.commoncrawl.org) |
| AI2Bot | Allen Institute for AI | Training | None available |
| Slurp | Yahoo | Search / index | Published IP ranges, reverse DNS (crawl.yahoo.net) |
| YandexBot | Yandex | Search / index | Reverse DNS (yandex.ru, yandex.net, yandex.com) |
| YandexAdditional | Yandex | Search / index | Reverse DNS (yandex.ru, yandex.net, yandex.com) |
| Baiduspider | Baidu | Search / index | Reverse DNS (baidu.com, baidu.jp) |
| PetalBot | Huawei | Search / index | Reverse DNS (petalsearch.com) |
| Bytespider | ByteDance | Training | None available |
| cohere-ai | Cohere | Training | None available |

Every agent in the table rests on its operator's own documentation. A crawler that only appears in third-party bot lists is not added.

Some entries cover more than one user agent: GoogleOther includes GoogleOther-Image and GoogleOther-Video, Google-GeminiNotebook includes its earlier name Google-NotebookLM, YandexAdditional includes YandexAdditionalBot, Baiduspider includes its image, video and news variants, and ExaSearchBot and ExaUser include their image fetchers.

Anthropic and DuckDuckGo don't publish a machine-readable range list for the agents marked "IP ranges maintained by Quotable", so those ranges are maintained by Quotable. When no range is loaded for an agent, its requests stay unverified.

Google-Extended is a robots.txt control token, not a user agent Google sends. A request that claims to be Google-Extended is still recorded, but it can never be verified.

Search crawlers such as Googlebot, Bingbot, YandexBot, Baiduspider and Slurp are listed because the indexes they build also feed AI answers. Requests from agents that are not in the registry are not stored.

Googlebot-Image, Googlebot-Video and AdIdxBot have their own rows since 11 November 2026. Before that their requests were counted as Googlebot and Bingbot, and events stored before it keep that label.

> [!TIP]
>
> "None available" means the provider publishes no IP ranges or hostnames for that agent. "Not supported yet" means the provider publishes a way to check the agent that Quotable doesn't read yet, such as signed requests or a list in another format. In both cases the requests show as **unverified**. That is a statement about the evidence, not an accusation. See [How verification works](https://docs.usequotable.com/agent-analytics/how-verification-works.md).

## Intents

Intent comes from the purpose each provider documents for its agent, plus one behavioural signal: the HTTP method.

| Intent | Meaning | Examples |
| - | - | - |
| Training | Collects pages to train models. | GPTBot, ClaudeBot, MistralAI-Training, Applebot-Extended |
| Search / index | Builds a search index that answers later retrieve from. | OAI-SearchBot, Claude-SearchBot, PerplexityBot, MistralAI-Index, Googlebot |
| User query / retrieval | Fetches a page on behalf of a person asking a question right now. | ChatGPT-User, Claude-User, Perplexity-User, Amzn-User |
| Agent / action | An agent that browses and acts for a user, or a user-query agent that sent a `POST`, `PUT`, `PATCH` or `DELETE`, for example submitting a form. | Claude-Agent, Google-Agent, any user-query agent using a write method |
| Other / unknown | An agent whose documented purpose is none of the above, or whose provider names no single purpose. | OAI-AdsBot, GoogleOther, CCBot |

Blocking a training crawler does not stop search indexers or user fetchers from the same provider. Each agent obeys its own robots.txt rules.

## Privacy by design

Agent Analytics stores a reduced, privacy-safe record of each agent request. These never cross into storage:

* **Client IP addresses.** Used in memory for verification, then discarded. The record keeps only the verification result.
* **Full user agent strings.** Reduced to the recognized agent and provider.
* **Query strings and URL fragments.** Stripped from every path.
* **Cookies, request headers and bodies.** Not read from the log record.
* **Full referrer URLs.** Reduced to the referring host.

Paths are also scrubbed before storage: segments that look like IDs, tokens or email addresses are replaced with `:id`, `:token` or `:redacted`, and paths are cut to 2,048 characters.

Requests to these paths are dropped and not stored: `/admin`, `/auth`, `/private`, `/_next`, `/assets`, `/static`, and static files ending in `.css`, `.js`, `.map`, `.png`, `.jpg`, `.jpeg`, `.gif`, `.webp`, `.svg`, `.ico`, `.woff`, `.woff2`, `.ttf` or `.eot`.

## Plans and quotas

Agent Analytics is available on every plan. Your plan sets a monthly allowance of **accepted** agent events for the whole workspace, a daily limit for each source, and the largest log file one import can upload. See [brand plans](https://docs.usequotable.com/workspace/plans-and-limits.md#brand-plans) and [agency plans](https://docs.usequotable.com/workspace/plans-and-limits.md#agency-plans) for the numbers.

Human traffic, excluded paths, invalid records and duplicates don't count toward either limit. Enterprise limits can be raised by contract. See [Quotas](https://docs.usequotable.com/agent-analytics/getting-started.md#quotas) for what happens when a source reaches its limit.

## Next steps

> [card] [Get started](https://docs.usequotable.com/agent-analytics/getting-started.md)
>
> Pick a connector and confirm your first delivery.

> [card] [Read the dashboard](https://docs.usequotable.com/agent-analytics/dashboard.md)
>
> What each KPI, tab and alert means.

> [card] [How verification works](https://docs.usequotable.com/agent-analytics/how-verification-works.md)
>
> Verified, unverified and spoofed, explained.


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.