Three weeks ago I wrote about the difference between AI training crawlers and AI...
An audit found 38 of 50 major publishers block AI citation agents via robots.txt or JavaScript-only pages. This kills referral traffic from AI-powered answers—while OpenAI licensing deals give select competitors citation priority.
Three weeks ago I wrote about the difference between AI training crawlers and AI retrieval
agents:
GPTBot collects data to train models, but it's ChatGPT-User and OAI-SearchBot that fetch
your page live when ChatGPT answers a question — and only those can cite and link you.
Block them and you don't exist in AI answers, no matter how well you rank on Google.
More and more answers reach your readers through ChatGPT, Claude and Perplexity instead of a blue...
19% of the top 2,000 sites block AI crawlers On 2 August 2026 I scanned the top 2,000...
Most AEO/GEO advice hands you a checklist: add structured data, write answer-first, put a date on it,...
You built a fast site. Clean HTML. Proper schema. Good content. You checked your Google Search...
SEO is not dead. Here's how to get cited more often and boost search visibility in AI tools today.
You blocked GPTBot in robots.txt to keep your content out of training runs — and then wondered why...
