Google AI reaches doctor-level performance in video medical consultations

AMIE (Video) represents a significant departure from prior medical AI efforts, which have relied on text input and therefore lose the non-verbal dimensions essential to clinical assessment. The research was motivated by the observation that audio-visual interaction is the standard for patient-physician consultations, enabling both natural communication and effective detection of illness through non-verbal cues. While earlier attempts to extend medical AI to audio-visual settings demonstrated feasibility, they did not reach clinician-level performance. The new system addresses this gap by combining Gemini-based multi-agent architecture with low-latency dialogue, clinical reasoning, and real-time audio-visual perception.

The study's design—a randomized OSCE with 30 primary care physicians, 15 patient actors, and 100 scenarios—provides a rigorous evaluation framework. Clinical evaluators rated AMIE (Video) on par or better than physicians in core clinical tasks: history-taking, diagnosis, management, and physical observation and examination. However, the research also surfaces a nuanced picture: patient actors rated AMIE's approach to assessing and explaining conditions favorably, but still preferred physicians for rapport and partnership building. This suggests that while the AI has closed a significant gap in clinical competence, it has not yet replicated the relational aspects of care that patients value. The authors acknowledge that limitations in fine anatomical precision, subtle emotional cues, and rapid movements remain, and stress that real-world translation awaits further development.