QwenBot
by Alibaba
AI training
AI
UA only (unverifiable)
Collects pages in bulk to train a model, unconnected to any individual user's question.
Alibaba crawler collecting public content for its Qwen models.
What it usually means
Alibaba crawled this page as potential training data for its Qwen models.
How to identify it
User-Agent tokens
qwenbot robots.txt stanza
User-agent: QwenBot Sources
More from Alibaba
Similar bots
AI2Bot
Allen AI AI2Bot is an AI-related crawler operated by Allen AI.
Applebot-Extended
Apple Robots token controlling whether Apple may use crawled content for Apple Intelligence training.
Bytespider
ByteDance ByteDance crawler collecting public content used to train its AI models.
ChatGLM-Spider
Zhipu AI Zhipu AI crawler collecting public content for its ChatGLM models.
See if QwenBot has visited your site
Kitbase verifies and tracks bot and AI crawler traffic separately from human visitors, so you know exactly who's hitting your site.
Start Free Trial