Cloudflare CEO: AI Agent Optimisation Mirrors New SEO Trends
AI agent optimisation is evolving into a new form of SEO, impacting how brands are recommended by AI engines like ChatGPT and Bing Copilot.
Understanding AI Agent Optimisation
On 8 November 2026, Cloudflare's CEO highlighted a significant shift in how AI engines like ChatGPT, Claude, Perplexity, and Bing Copilot operate. He likened AI agent optimisation to a new version of Search Engine Optimisation (SEO), a vital aspect for brands aiming to enhance their visibility and recommendations by these AI platforms. This analogy underscores the evolving landscape of digital marketing where traditional SEO practices are being adapted to accommodate AI technologies.
AI agent optimisation involves tailoring content and technical website aspects to be more easily understood and prioritised by AI crawlers. These crawlers, which are automated scripts used by AI engines to discover and index content, now require specific cues or 'hints' to determine when pages are updated. This process is similar to SEO's focus on keywords and metadata but is now more intricate due to the dynamic nature of AI engines.
The Role of AI Crawlers
Cloudflare's CEO noted that OpenAI, the developer behind ChatGPT, compensates for these hints, signalling a shift where AI crawlers play a crucial role in determining brand visibility. This means that brands need to be proactive in managing how their content is indexed by AI engines. By providing clear and structured data, businesses can ensure that their updates are recognised promptly, thereby maintaining or improving their standing in AI-generated recommendations.
This development indicates a future where brands might negotiate terms with AI platforms regarding crawler access and data usage, much like how they currently manage search engine partnerships. As AI engines become more sophisticated, the ability to communicate changes and updates effectively will be critical for maintaining competitive visibility.
Implications for Brands
For marketing and growth leaders, this evolution presents both challenges and opportunities. Brands must now consider AI agent optimisation as an integral part of their digital strategy. This includes investing in technologies and workflows that facilitate better integration with AI systems. Additionally, businesses should explore partnerships with AI platforms to gain insights into how their content is being processed and ranked.
Ultimately, as AI continues to shape the digital landscape, brands that adapt to these changes will be better positioned to leverage AI engines for enhanced visibility and audience engagement.
Run a free AI visibility scan at geomaestros.com.