Amazonbot

by Amazon

Search engine UA + reverse DNS

Crawls pages for a traditional search index, which is what lets them rank.

Amazon crawler used to improve Alexa answers and Amazon products.

What it usually means

Amazon is crawling this page to support Alexa's answers and its own product surfaces.

User-Agent tokens

amazonbot

robots.txt stanza

User-agent: Amazonbot

Reverse DNS suffixes

.crawl.amazonbot.amazon

Amazon crawler that makes content eligible for Amazon search experiences.

User-triggered Amazon fetches for fresh answers in products such as Alexa.

Apple crawler for Siri and Spotlight Suggestions, spanning search and training use.

Baidu's crawler for its search index.

Microsoft crawler for Bing Search indexing.

DuckDuckGo's crawler for its own search results.

Kitbase verifies and tracks bot and AI crawler traffic separately from human visitors, so you know exactly who's hitting your site.