A website can be indexed, receive search traffic, and show no obvious issue in standard SEO tools while some AI crawlers cannot retrieve its pages. That gap is the central finding in a documented case involving WP Engine, where platform-level controls reportedly block or rate-limit certain AI bots before their requests reach a customer's WordPress installation.
Search Engine Land's investigation into managed WordPress AI bot blocking describes evidence from Cloudflare logs and bot-specific curl probes. It identifies GPTBot, ClaudeBot, and PerplexityBot among the high-impact crawlers affected by a default platform-level restriction on WP Engine. According to the report, the control is non-disableable and sits outside WordPress settings, robots.txt, and the dashboards many site owners use to monitor search performance.
The important point is not that every managed host behaves the same way. Search Engine Land notes that host behavior varies. The WP Engine example matters because it demonstrates a practical blind spot: traditional SEO measurement does not necessarily prove AI fetchability. For businesses working on generative engine optimization (GEO) or answer engine optimization (AEO), testing whether relevant AI systems can fetch important pages should be a defined audit step.
