The short answer
Google, OpenAI and Microsoft's Bing said on 30 October 2026 that they will honour one shared robots.txt line to keep your site out of AI training. None of them uses it yet: Bing starts on 1 February 2027, and Google and OpenAI plan to follow in 2027.
What we know
- Confirmed by Google: its Search Central post says a site that opts out with the shared line counts as blocking Google-Extended, unless the site names Google-Extended itself.
- Confirmed by OpenAI: its announcement says it will honour the signal "in the coming months" and keep its existing crawler rules.
- Confirmed by Bing: its blog post gives the line and says it does not change normal Bing results.
- The line comes from a draft at the IETF, the body that writes internet standards. The draft is not final.
The line itself:
User-Agent: __usage_ai-training
Disallow: /
What it means for your ad account
| Company | Starts | Separate control that still works |
|---|---|---|
| 2027, "early 2027" on its crawler page | Google-Extended | |
| OpenAI | "In the coming months" | GPTBot |
| Bing | 1 February 2027 | Grounding setting in Webmaster Tools |
The shared line covers training only. Ad crawlers are separate, and blocking them can stop your ads. OpenAI's ad rules say landing pages must not block OAI-AdsBot, as our ChatGPT ads news explains.
What to do this week
- Open yoursite.com/robots.txt and list every AI and ad crawler it names.
- Decide on AI training with whoever owns the site. Nothing needs changing today.
- Keep ad crawlers allowed: AdsBot-Google, OAI-AdsBot and FacebookExternalHit. Our Meta crawler page lists Meta's five bots.
- Note 1 February 2027 for Bing and recheck in early 2027 for Google.
- Read our Gemini vs ChatGPT for ads page before you block either assistant's search crawlers.
FAQ
Does the shared line hide my site from Google Search?
No. Google says Google-Extended does not affect Search ranking, and Bing says normal results do not change.
Does Meta honour the shared line?
Meta has not said so. Use its own crawler names in robots.txt for now.
Will blocking AI training stop my ads?
Not by itself. Ads break only if you also block an ad crawler such as AdsBot-Google or OAI-AdsBot.