---
id: "nr-cloudflare-lets-sites-disallow-ai-training-without-leaving-search-92d32a"
slug: "cloudflare-lets-sites-disallow-ai-training-without-leaving-search-92d32a"
title: "Cloudflare lets sites disallow AI training without leaving search"
observed_at: "2026-09-18T13:36:42.507001+00:00"
record_date: "2026-09-18"
date_kind: "observed_at"
novelty: "new"
source_platform: "blog.cloudflare.com"
topics: ["ai-crawlers","security","search"]
entities: ["Cloudflare","Applebot","Bingbot","Googlebot"]
related_patterns: []
source_url: "https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers"
source_urls: ["https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers"]
basket: {"id":"0325e6b8-f527-4f9b-bfa3-3f30e57f380b","revision":1,"cluster_id":"92d32a32-d16f-4ecc-809b-acb119e2448c"}
type: "raw_signal"
description: "Cloudflare's Disallow AI Training setting refuses training by mixed-use crawlers while Applebot, Bingbot, and Googlebot keep indexing for search."
why_it_matters: "Site owners no longer have to trade search visibility for a training opt-out with the largest crawlers, but the Block setting now removes search too, so existing configurations deserve a check. The AI-summary control is still a stated plan."
verification_level: "source-inspected"
signal_type: "newsroom_basket_signal"
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "signal:cloudflare-lets-sites-disallow-ai-training-without-leaving-search-92d32a"
retrieval_nugget: "Cloudflare's Disallow AI Training setting refuses training by mixed-use crawlers while Applebot, Bingbot, and Googlebot keep indexing for search. Cloudflare introduced a Disallow AI Training setting for its bot controls. It publishes a no-training preference in robots.txt through Bot Preference Sync, keeps Accountable mixed-use crawlers such as Applebot, Bingbot, and Googlebot allowed for search, and blocks every other training crawler."
status: "published"
visuals: []
routes: {"html":"https://newruntime.com/signals/cloudflare-lets-sites-disallow-ai-training-without-leaving-search-92d32a/","markdown":"https://newruntime.com/signals/cloudflare-lets-sites-disallow-ai-training-without-leaving-search-92d32a.md","json":"https://newruntime.com/signals/cloudflare-lets-sites-disallow-ai-training-without-leaving-search-92d32a.json"}
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
---

# Cloudflare lets sites disallow AI training without leaving search

## Retrieval answer

Cloudflare's Disallow AI Training setting refuses training by mixed-use crawlers while Applebot, Bingbot, and Googlebot keep indexing for search. Cloudflare introduced a Disallow AI Training setting for its bot controls. It publishes a no-training preference in robots.txt through Bot Preference Sync, keeps Accountable mixed-use crawlers such as Applebot, Bingbot, and Googlebot allowed for search, and blocks every other training crawler.

Cloudflare introduced a Disallow AI Training setting for its bot controls. It publishes a no-training preference in robots.txt through Bot Preference Sync, keeps Accountable mixed-use crawlers such as Applebot, Bingbot, and Googlebot allowed for search, and blocks every other training crawler. Apple, Google, and Microsoft honor the setting or have committed to honor it within a stated time frame. Cloudflare reports that fewer than 1% of its sites block search bots, while 17% use some mechanism to block training.

The Accountable designation requires a training opt-out, an opt-out for AI summaries, URL-level visibility into which pages were used for training, and an assurance that opting out of training does not affect search. Block and Block on pages with ads now also stop mixed-use crawlers, which removes search as well; Block AI Bots and Managed Robots.txt are being deprecated in favor of the Search, Training, and Agent controls. Control over how much content appears in AI summaries is a goal for early next year, not a shipped feature.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- topic hub: [Ai Crawlers](https://newruntime.com/topics/ai-crawlers.md): Explore the ai-crawlers topic hub.
- topic hub: [Security](https://newruntime.com/topics/security.md): Explore the security topic hub.
- topic hub: [Search](https://newruntime.com/topics/search.md): Explore the search topic hub.
- collection: [Raw Signals](https://newruntime.com/signals.json): Open every source-linked raw signal.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)