Cloudflare has spent a year arming websites against AI crawlers. Now it wants to help one crawl better. The company said on Wednesday it is running a research pilot with OpenAI to test whether its network data can make AI search more accurate.
Cloudflare sits in front of more than a fifth of the web. That vantage point lets it watch how pages change and how traffic behaves in real time. The pilot feeds those signals, such as content freshness and traffic quality, into OpenAI’s search and answer system.
Why freshness matters
AI answers rise or fall on the pages behind them. When an index lags, a chatbot serves stale or plain wrong information. OpenAI wants Cloudflare’s live view of the web to help ChatGPT discover new content sooner.
OpenAI has also signed content deals to feed ChatGPT. This pilot targets a different gap. It tackles discovery, not licensing.
