GPTBot
by OpenAI
Collects pages in bulk to train a model, unconnected to any individual user's question.
OpenAI crawler for collecting public content that may improve future models.
What it usually means
OpenAI crawled this page as potential training data. This is the crawler most sites choose to allow or block deliberately.
How to identify it
gptbot User-agent: GPTBot How it's verified
132.196.86.0/24172.182.202.0/25172.182.204.0/24172.182.207.0/25172.182.214.0/24172.182.215.0/2420.125.66.80/2820.171.206.0/2420.171.207.0/244.227.36.0/25 6 IP sources configured
Sources
More from OpenAI
Similar bots
AI2Bot is an AI-related crawler operated by Allen AI.
AliyunBot is an AI-related crawler operated by Alibaba.
Robots token controlling whether Apple may use crawled content for Apple Intelligence training.
ByteDance crawler collecting public content used to train its AI models.
See if GPTBot has visited your site
Kitbase verifies and tracks bot and AI crawler traffic separately from human visitors, so you know exactly who's hitting your site.
Start Free Trial