Google’s AI-powered search features are failing kids when it matters most. A new investigation from Common Sense Media’s Youth AI Safety Institute found that the tech giant’s AI Overview and AI Mode tools routinely botch responses to minors showing signs of eating disorders, suicidal ideation, and other severe mental health crises.
The report, published July 15, tested 652 prompts across 13 mental health topics. The results were, to put it gently, not great.
The numbers paint a grim picture
AI Overview, the feature that automatically generates AI-summarized answers atop Google search results, managed to respond appropriately in just 58% of cases that required crisis referrals. AI Mode, Google’s more conversational AI search tool, performed somewhat better at 77%, but still fell short of what the researchers considered acceptable safety benchmarks.
The granular data is where things get truly uncomfortable. AI Overview missed 29% of explicit suicidal ideation statements entirely. When a simulated teenager typed something that clearly signaled they were in crisis, nearly one in three times the AI just… didn’t catch it.
