Agent-Readiness Grade / Crawlers / Amazonbot

Amazonbot

Amazon · training. Source: https://developer.amazon.com/amazonbot, read 2026-09-29. Where the vendor page does not state a fact, this page says "not published".

Facts from the vendor page

Operator Amazon

What it is for Product and training crawler. Amazon says Amazonbot is used to improve its products and services, helps provide more accurate information to customers, and may be used to train Amazon AI models. (Amazon documents two further agents, Amzn-SearchBot and Amzn-User, which it says do not crawl for generative AI training.)

Published user-agent string Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36
Example string from the vendor page; W.X.Y.Z is a version placeholder.

Honors robots.txt Yes. Amazon says automated crawling from its listed agents respects the Robots Exclusion Protocol (user-agent, allow and disallow), reads robots.txt per host and may use a copy cached for up to 30 days, treats an unfetchable file as absent, honors rel=nofollow and the noarchive, noindex and none meta tags, does not support crawl-delay, and needs about 24 hours to reflect changes.

Verification (IP ranges or reverse DNS) Published IP addresses at https://developer.amazon.com/amazonbot/ip-addresses/.

robots.txt token Amazonbot

Operator	Amazon
What it is for	Product and training crawler. Amazon says Amazonbot is used to improve its products and services, helps provide more accurate information to customers, and may be used to train Amazon AI models. (Amazon documents two further agents, Amzn-SearchBot and Amzn-User, which it says do not crawl for generative AI training.)
Published user-agent string	`Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36` Example string from the vendor page; W.X.Y.Z is a version placeholder.
Honors robots.txt	Yes. Amazon says automated crawling from its listed agents respects the Robots Exclusion Protocol (user-agent, allow and disallow), reads robots.txt per host and may use a copy cached for up to 30 days, treats an unfetchable file as absent, honors rel=nofollow and the noarchive, noindex and none meta tags, does not support crawl-delay, and needs about 24 hours to reflect changes.
Verification (IP ranges or reverse DNS)	Published IP addresses at https://developer.amazon.com/amazonbot/ip-addresses/.
robots.txt token	`Amazonbot`

robots.txt lines

To allow Amazonbot explicitly (so your policy survives a change to the User-agent: * group):

User-agent: Amazonbot
Allow: /

To block it:

User-agent: Amazonbot
Disallow: /

What Agent-Readiness Grade checks for Amazonbot

The crawler-access area parses your robots.txt by user-agent group and reports Amazonbot as allowed, disallowed or unmentioned (unmentioned means allowed by default). A group for "Amazonbot" wins over the "*" group; "Disallow: /" or "Disallow: /*" without a matching "Allow: /" counts as blocked; narrower path rules are reported as partial. Amazonbot is one of the 8 tokens in that score (GPTBot, ClaudeBot, OAI-SearchBot, PerplexityBot, Google-Extended, Amazonbot, CCBot, Bytespider).

Context: in the 30-day census of one Cloudflare zone (2026-08-29 to 2026-09-28), 8,318 requests carried a user agent matching "Amazonbot". See the census report.

Other crawlers

GPTBot · OAI-SearchBot · ChatGPT-User · ClaudeBot · Claude-User · PerplexityBot · Google-Extended · CCBot · Bytespider

Free agent-readiness checkers are a crowded category: Goodie, Frase, aiwebreadiness.com, Arobis, Rank Prompt, Otterly and Writesonic each offer one. Of the checkers we looked at, Agent-Readiness Grade is the only one we found that grades payment and agent-checkout surfaces (/.well-known/x402, agent-card.json, mcp-registry-auth, openapi.json, the MCP endpoint) and legal notices. Statement dated 2026-09-29.