Amazonbot: what it does, and what blocking it means
One token covering both Alexa answers and Amazon AI training. There is no way to split them.
| Operator | Amazon |
|---|---|
| What it does | Search & training |
| Obeys robots.txt | Yes, per its operator's docs |
| Governs | AI model training |
| Has a crawler | Yes |
| Last verified | 2 September 2026 |
| Next review | 2 December 2026. We re-check every entry against the operator’s documentation each quarter. |
What happens if you block Amazonbot?
Blocking it affects
- Alexa answers
- Amazon AI training (one token covers both)
Can you block Amazonbot for training and stay in Alexa?
That is the finding. If you want out of Amazon's training data, the same rule takes you out of Alexa's answers, and Amazon offers no second token to separate the two. A genuine trade-off rather than an oversight to work around.
Amazonbot caches robots.txt for up to 30 days, so a change here takes effect slowly. Check the next day and you will not see it. It honours noarchive and noindex.
How do you spot Amazonbot in your logs?
To find Amazonbot in your logs, match the User-Agent shown on this page. The robots.txt token is what the crawler reads, not what appears in the request.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36Anyone can send that User-Agent, so treat it as a claim. Amazon's published IP ranges are the stronger way to verify the request.
How do you block or allow Amazonbot in robots.txt?
To block Amazonbot:
User-agent: Amazonbot
Disallow: /To allow it explicitly, use an Allow: / rule if your file has a blanket User-agent: * disallow:
User-agent: Amazonbot
Allow: /With neither rule, Amazonbot is allowed by default.
Not sure how Amazonbot fits with the others? Build the whole file, or see which AI crawlers to allow.
How many sites block Amazonbot?
In our scan of the Tranco top 1,000 (1 to 2 October 2026, 499 sites measured), 10.4% disallowed Amazonbot in robots.txt. We read the rules for Amazonbot but did not request pages as it, so how many servers would refuse it is not measured.
Is your site blocking Amazonbot?
A CDN or bot-management rule can still block Amazonbot even when robots.txt says it is welcome. You cannot see that mismatch from the front of the site.
We request your robots.txt and homepage. We read your sitemap only when robots.txt hides pages from a crawler and we need to measure how much is affected. No other page.
Official sources
- Amazon’s crawler documentation
- Published IP ranges is the only way to verify a request claiming this user agent really came from Amazon
Which other crawlers do the same job as Amazonbot?
- Applebot: Search & training, run by Apple