Anthropic's web scraping practices spotlight ethical AI dilemmas, with a high crawl-to-refer ratio undermining the digital content economy.

Cloudflare is piloting with OpenAI to feed real-time network signals into ChatGPT's search, a turn for a firm built on blocking AI crawlers.

Cloudflare helps reshape how compliant crawlers behave, yet biggest content leakage is gray scraping economy that doesn’t play by those rules.