Googlebot
by Google
Crawls pages for a traditional search index, which is what lets them rank.
Google's main crawler for Search indexing and discovery.
What it usually means
Google is crawling this page for its search index. This is the traffic that determines whether the page can rank.
How to identify it
googlebot User-agent: Googlebot How it's verified
- https://developers.google.com/static/crawling/ipranges/common-crawlers.json
- https://developers.google.com/static/crawling/ipranges/special-crawlers.json
- https://developers.google.com/static/crawling/ipranges/user-triggered-fetchers.json
- https://developers.google.com/static/crawling/ipranges/user-triggered-fetchers-google.json
- https://developers.google.com/static/crawling/ipranges/user-triggered-agents.json
2001:4860:4801:10::/642001:4860:4801:11::/642001:4860:4801:12::/642001:4860:4801:13::/642001:4860:4801:14::/642001:4860:4801:15::/642001:4860:4801:16::/642001:4860:4801:17::/642001:4860:4801:18::/642001:4860:4801:19::/64 5 IP sources configured
.googlebot.com.google.com.googleusercontent.com Sources
More from Google
Google crawler for targeted crawls requested by site owners building Vertex AI agents.
Google crawler used by Search testing tools such as Rich Results Test and URL Inspection.
Google fetcher associated with NotebookLM-style answer workflows.
Google fetcher associated with read-aloud and assistant experiences.
Google user-triggered fetcher used by AI or product experiences.
Google user-triggered fetcher used by AI or product experiences.
Generic Google crawler used by product teams for public content fetches, including research and development.
Robots token controlling whether Google may use crawled content for Gemini training and grounding; not a separate HTTP crawler.
Similar bots
Amazon crawler used to improve Alexa answers and Amazon products.
Amazon crawler that makes content eligible for Amazon search experiences.
Apple crawler for Siri and Spotlight Suggestions, spanning search and training use.
Baidu's crawler for its search index.
See if Googlebot has visited your site
Kitbase verifies and tracks bot and AI crawler traffic separately from human visitors, so you know exactly who's hitting your site.
Start Free Trial