YiyanBot

by Baidu

AI training AI UA only (unverifiable)

Collects pages in bulk to train a model, unconnected to any individual user's question.

YiyanBot is an AI-related crawler operated by Baidu.

What it usually means

Baidu crawled this page as part of its AI crawling.

User-Agent tokens

yiyanbot

robots.txt stanza

User-agent: YiyanBot

Baidu's crawler for its search index.

Baidu crawler collecting public content for its ERNIE models.

AI2Bot is an AI-related crawler operated by Allen AI.

AliyunBot is an AI-related crawler operated by Alibaba.

Robots token controlling whether Apple may use crawled content for Apple Intelligence training.

ByteDance crawler collecting public content used to train its AI models.

Kitbase verifies and tracks bot and AI crawler traffic separately from human visitors, so you know exactly who's hitting your site.