> ## Documentation Index
> Fetch the complete documentation index at: https://docs.usequotable.com/llms.txt
> Use this file to discover all available pages before exploring further.

# QuotableBot

> Who QuotableBot is, when it visits a site, how it treats robots.txt, and how to allow or block it.

QuotableBot is the name Quotable uses whenever it requests a page on a website. If you see it in your logs, a Quotable customer's work needed a page from your site.

## How to recognize it

Requests carry this user agent:

```text theme={"system"}
Mozilla/5.0 (compatible; QuotableBot/1.0; +https://usequotable.com)
```

The robots.txt token is `QuotableBot`.

## When it visits

QuotableBot requests a page only when a customer's work in Quotable needs it, for example:

* reading the pages that AI answers cite, to see which brands they mention
* reading a brand's own site and its competitors' pages during setup and research
* running the daily [site check](https://docs.usequotable.com/actions/site-checks.md) on a customer's own domain
* reading a sitemap or a page that a customer added to a table, an agent or a report
* reading a product feed or a file at an address the customer gave us

It requests individual pages and sitemaps. It does not sign in, submit forms or buy anything.

## How it treats robots.txt

QuotableBot follows robots.txt as described in [RFC 9309](https://www.rfc-editor.org/rfc/rfc9309). Before it requests a page, it reads the group for `User-agent: QuotableBot`, or the `*` group when there is none.

* **No robots.txt.** When the file doesn't exist, every page is allowed.
* **The file can't be read.** When the server answers with an error or doesn't answer, QuotableBot stays off the site and tries again later.

Two kinds of request skip robots.txt because the site owner asked for them directly:

* the [site check](https://docs.usequotable.com/actions/site-checks.md) of a customer's own domain, which reads robots.txt to report what it allows
* an address a customer set up for Quotable to call, such as their own product feed

## Block QuotableBot

Add this to your robots.txt to keep it off the whole site:

```text theme={"system"}
User-agent: QuotableBot
Disallow: /
```

To keep it off part of the site, disallow those paths instead. Pages it can't read are shown in Quotable as unreadable.

## Allow QuotableBot

If your firewall or bot protection challenges unknown bots, allow requests whose user agent contains `QuotableBot`. QuotableBot doesn't come from a published set of IP addresses, so allow it by user agent.

## Contact

Questions about QuotableBot's visits to your site go to [support@usequotable.com](mailto:support@usequotable.com).


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.