GrokBot
by xAI
Collects pages in bulk to train a model, unconnected to any individual user's question.
GrokBot is an AI-related crawler operated by xAI.
What it usually means
xAI crawled this page as part of its AI crawling.
How to identify it
grokbot User-agent: GrokBot Sources
More from xAI
xAI fetcher used by Grok's DeepSearch to gather sources for an answer.
xAI-Web-Crawler is an AI-related crawler operated by xAI.
User-triggered fetches when Grok answers a person's question.
xAI-Grok is an AI-related crawler operated by xAI.
xAI-Bot is an AI-related crawler operated by xAI.
Grok is an AI-related crawler operated by xAI.
Similar bots
AI2Bot is an AI-related crawler operated by Allen AI.
AliyunBot is an AI-related crawler operated by Alibaba.
Robots token controlling whether Apple may use crawled content for Apple Intelligence training.
ByteDance crawler collecting public content used to train its AI models.
See if GrokBot has visited your site
Kitbase verifies and tracks bot and AI crawler traffic separately from human visitors, so you know exactly who's hitting your site.
Start Free Trial