LaunchPolicySeptember 15, 2026

Cloudflare launches Disallow AI Training setting for mixed-use crawlers

Cloudflare's new setting lets sites stay indexed for search while refusing AI training on the same crawler; Apple, Google, and Microsoft honor or have committed to honor it. Under 1% of Cloudflare sites block Search bots, while 17% enable some training-blocking mechanism.

1 source

More stories today

Open the live feed