Hacker News
Cloudflare: Stay discoverable in search while disallowing AI training
Cloudflare has added a “Disallow AI Training” setting that lets site owners keep their pages indexed for search while preventing mixed-use crawlers from using the content to train AI models. Apple, Google, and Microsoft have committed to honor the setting, and Cloudflare plans to give owners granular control over AI summaries and visibility into crawler activity.