Skip to content

News · AI search

Google, OpenAI and Bing will honour one robots.txt line to opt out of AI training

Marxx · Updated 31 Oct 2026 · 2 min read

Google, OpenAI and Bing will honour one robots.txt line to opt out of AI training: On 30 October 2026, Google, OpenAI and Bing said they will honour one shared robots.txt line for AI training. What it changes and which ad bots to keep.

The short answer

Google, OpenAI and Microsoft's Bing said on 30 October 2026 that they will honour one shared robots.txt line to keep your site out of AI training. None of them uses it yet: Bing starts on 1 February 2027, and Google and OpenAI plan to follow in 2027.

At a glance: What we know, What it means for your ad account, What to do this week
At a glance

What we know

  • Confirmed by Google: its Search Central post says a site that opts out with the shared line counts as blocking Google-Extended, unless the site names Google-Extended itself.
  • Confirmed by OpenAI: its announcement says it will honour the signal "in the coming months" and keep its existing crawler rules.
  • Confirmed by Bing: its blog post gives the line and says it does not change normal Bing results.
  • The line comes from a draft at the IETF, the body that writes internet standards. The draft is not final.

The line itself:

User-Agent: __usage_ai-training
Disallow: /

What it means for your ad account

Company Starts Separate control that still works
Google 2027, "early 2027" on its crawler page Google-Extended
OpenAI "In the coming months" GPTBot
Bing 1 February 2027 Grounding setting in Webmaster Tools

The shared line covers training only. Ad crawlers are separate, and blocking them can stop your ads. OpenAI's ad rules say landing pages must not block OAI-AdsBot, as our ChatGPT ads news explains.

What to do this week

  1. Open yoursite.com/robots.txt and list every AI and ad crawler it names.
  2. Decide on AI training with whoever owns the site. Nothing needs changing today.
  3. Keep ad crawlers allowed: AdsBot-Google, OAI-AdsBot and FacebookExternalHit. Our Meta crawler page lists Meta's five bots.
  4. Note 1 February 2027 for Bing and recheck in early 2027 for Google.
  5. Read our Gemini vs ChatGPT for ads page before you block either assistant's search crawlers.

FAQ

Does the shared line hide my site from Google Search?

No. Google says Google-Extended does not affect Search ranking, and Bing says normal results do not change.

Does Meta honour the shared line?

Meta has not said so. Use its own crawler names in robots.txt for now.

Will blocking AI training stop my ads?

Not by itself. Ads break only if you also block an ad crawler such as AdsBot-Google or OAI-AdsBot.

See what your competitors are running today.

Marxx tracks every ad in your sector, shows you what is working and builds the next ad on the same canvas you publish from.