---
title: "What is Google-Extended? Google's Bot Explained | Kitbase"
description: "Robots token controlling whether Google may use crawled content for Gemini training and grounding; not a separate HTTP crawler."
canonical: https://kitbase.dev/bot-directory/google-extended
---

[Home](/) [Bot Directory](/bot-directory) Google-Extended

# Google-Extended

by Google

AI training AI UA only (unverifiable)

Collects pages in bulk to train a model, unconnected to any individual user's question.

Robots token controlling whether Google may use crawled content for Gemini training and grounding; not a separate HTTP crawler.

## What it usually means

Google is treating this page as eligible AI training data. Blocking it removes you from Gemini training without affecting Search.

## How to identify it

robots.txt stanza

`User-agent: Google-Extended`

Free tools

[Check if your site allows Google-Extended](/tools/ai-crawler-access-checker)

[Google's page for Google-Extended](https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers#google-extended)

## Sources

-   [Google crawler docs](https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers#google-extended)

## More from Google

[

Google-CloudVertexBot

Google crawler for targeted crawls requested by site owners building Vertex AI agents.

](/bot-directory/google-cloudvertexbot)[

Google-InspectionTool

Google crawler used by Search testing tools such as Rich Results Test and URL Inspection.

](/bot-directory/google-inspectiontool)[

Google-NotebookLM

Google fetcher associated with NotebookLM-style answer workflows.

](/bot-directory/google-notebooklm)[

Google-Read-Aloud

Google fetcher associated with read-aloud and assistant experiences.

](/bot-directory/google-read-aloud)[

Google-Agent

Google user-triggered fetcher used by AI or product experiences.

](/bot-directory/google-agent)[

GoogleAgent

Google user-triggered fetcher used by AI or product experiences.

](/bot-directory/googleagent)[

GoogleOther

Generic Google crawler used by product teams for public content fetches, including research and development.

](/bot-directory/googleother)[

Googlebot

Google's main crawler for Search indexing and discovery.

](/bot-directory/googlebot)

## Similar bots

[

AI2Bot

Allen AI

AI2Bot is an AI-related crawler operated by Allen AI.

](/bot-directory/ai2bot)[

AliyunBot

Alibaba

AliyunBot is an AI-related crawler operated by Alibaba.

](/bot-directory/aliyunbot)[

Applebot-Extended

Apple

Robots token controlling whether Apple may use crawled content for Apple Intelligence training.

](/bot-directory/applebot-extended)[

Bytespider

ByteDance

ByteDance crawler collecting public content used to train its AI models.

](/bot-directory/bytespider)

## See if Google-Extended has visited your site

Kitbase verifies and tracks bot and AI crawler traffic separately from human visitors, so you know exactly who's hitting your site.

[Start Free Trial](https://app.kitbase.dev/signup)