AliyunBot

by Alibaba

AI training AI UA only (unverifiable)

Collects pages in bulk to train a model, unconnected to any individual user's question.

AliyunBot is an AI-related crawler operated by Alibaba.

What it usually means

Alibaba crawled this page as part of its AI crawling.

User-Agent tokens

aliyunbot

robots.txt stanza

User-agent: AliyunBot

User-triggered fetches when Alibaba's Qwen opens a page to answer a person.

TongyiBot is an AI-related crawler operated by Alibaba.

Alibaba crawler collecting public content for its Qwen models.

AI2Bot is an AI-related crawler operated by Allen AI.

Robots token controlling whether Apple may use crawled content for Apple Intelligence training.

ByteDance crawler collecting public content used to train its AI models.

Zhipu AI crawler collecting public content for its ChatGLM models.

Kitbase verifies and tracks bot and AI crawler traffic separately from human visitors, so you know exactly who's hitting your site.