Cloudflare's New Feature: Control AI Training Without Blocking Googlebot
Cloudflare introduces a feature that allows websites to restrict AI training while maintaining search visibility, a game-changer for brand protection in AI-dominated search landscapes.
In an era where AI answer engines like ChatGPT, Claude, and Bing Copilot are reshaping how brands are recommended, maintaining control over how your brand data is used is crucial. On 15th September 2026, Cloudflare launched a feature that empowers websites to disallow AI training on their content without blocking search engine crawlers like Googlebot. This development marks a significant step for brands aiming to protect their identity and data online.
Understanding Cloudflare's Disallow AI Training Feature
Cloudflare's new feature, Disallow AI Training, enables website owners to prevent their content from being used to train AI models. This is accomplished without hindering the access of search engine crawlers such as Googlebot, which are essential for maintaining search visibility. This feature is particularly relevant in a landscape where AI engines are influencing brand visibility and recommendation.
The feature supports Google's and Apple's opt-out protocols, though support from Bing is still pending. This means that while Google and Apple will honor the opt-out requests, Bing's compliance is yet to be confirmed, highlighting a potential area for brands to monitor.
Implications for Brand Protection
For brands, this feature offers a strategic advantage in managing how their content is utilized by AI models. By controlling AI training access, brands can mitigate the risk of their data being used in ways that do not align with their interests or brand strategy. This is particularly significant given the rise of Generative Engine Optimisation (GEO), where AI engines determine which brands to recommend.
Furthermore, maintaining visibility on major search platforms like Google remains unaffected. Thus, brands can continue to optimize their presence on these platforms while safeguarding their content from being leveraged for AI training purposes.
Leveraging Structured Data and Crawler Access
Brands should consider combining this new feature with structured data and crawler access strategies. Structured data helps search engines understand the context of your content, enhancing the likelihood of being recommended by AI engines. With Cloudflare's feature, brands can finely tune their approach: allowing search engines to crawl and index their content while restricting AI training.
This dual approach ensures that brands are not only visible but also protected in the evolving AI landscape. As AI answer engines continue to evolve, maintaining a balance between visibility and data protection will be crucial for brand success.
Run a free AI visibility scan at geomaestros.com.