Google’s medical AI system just passed a test that most people assumed was still years away. In a double-blind crossover study published in Nature in April 2025, the company’s Articulate Medical Intelligence Explorer, known as AMIE, matched or outperformed primary care physicians across nearly every diagnostic metric thrown at it.
What the study actually found
The study involved 159 simulated case scenarios conducted across Canada, the UK, and India. Twenty primary care physicians participated in the randomized trial, going head-to-head with AMIE on complex diagnostic conversations.
Specialist doctors evaluated both the AI and human physicians across 32 performance metrics. AMIE outperformed or matched the PCPs on 30 of those 32 measures.
Patient-actors who interacted with both AMIE and the human doctors rated the AI system superior on 25 out of 26 metrics.
