How to recognize it
Requests carry this user agent:QuotableBot.
When it visits
QuotableBot requests a page only when a customer’s work in Quotable needs it, for example:- reading the pages that AI answers cite, to see which brands they mention
- reading a brand’s own site and its competitors’ pages during setup and research
- running the daily site check on a customer’s own domain
- reading a sitemap or a page that a customer added to a table, an agent or a report
- reading a product feed or a file at an address the customer gave us
How it treats robots.txt
QuotableBot follows robots.txt as described in RFC 9309. Before it requests a page, it reads the group forUser-agent: QuotableBot, or the * group when there is none.
- No robots.txt. When the file doesn’t exist, every page is allowed.
- The file can’t be read. When the server answers with an error or doesn’t answer, QuotableBot stays off the site and tries again later.
- the site check of a customer’s own domain, which reads robots.txt to report what it allows
- an address a customer set up for Quotable to call, such as their own product feed
Block QuotableBot
Add this to your robots.txt to keep it off the whole site:Allow QuotableBot
If your firewall or bot protection challenges unknown bots, allow requests whose user agent containsQuotableBot. QuotableBot doesn’t come from a published set of IP addresses, so allow it by user agent.