AIToday
Large Language ModelsAI in HealthcareGoogle AI BlogPublished: Aug 12, 2026, 04:00 JST

Google's AMIE medical AI demonstrates real-time video consultation in first study

Google's AMIE medical AI demonstrates real-time video consultation in first study

3 Key Points

  1. What happened

    Google Research and Google DeepMind have advanced AMIE, a research medical AI system built on Gemini and Project Astra, to conduct real-time clinical video consultations. In a randomized study with simulated consultations, clinical evaluators assessed AMIE favorably across history-taking, diagnostic accuracy, management appropriateness, and communication quality, and patient actors preferred video consultations over text chat.

  2. Why it matters

    AMIE can now interpret visual and auditory cues, guide virtual physical exams, and reason diagnostically in real time — capabilities that go beyond text-based AI. This represents a step toward AI systems that can observe physical signs like cough, gait, and visible discomfort, which human doctors rely on during in-person visits.

  3. What to watch

    Google emphasizes that AMIE remains a research system and more research is needed before responsible real-world clinical deployment. The company has not announced a timeline or availability for clinical use.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

AMIE's advancement into real-time video consultation marks a shift in how AI can be applied to clinical work. Previous medical AI systems, including text-based versions of AMIE, operated within the constraints of written dialogue. The new multimodal architecture, built on Gemini and Project Astra, enables the system to process the full range of sensory information — visual and auditory — that human clinicians depend on when evaluating patients. The study's design, using patient actors and primary care physicians as evaluators, provides a controlled setting where AMIE's performance on core clinical competencies could be measured against human expectations.

The preference expressed by patient actors for video over text chat suggests that the addition of visual communication itself may carry therapeutic value beyond diagnostic accuracy alone. However, Google's explicit framing of AMIE as a research system underscores the distance between a favorable demonstration and clinical readiness. The company has not disclosed what additional research or validation steps remain, what regulatory pathways it may pursue, or whether AMIE will eventually be offered as a product or service.

FAQ
How did the study evaluate AMIE's performance?
The study was randomized and used simulated consultations with patient actors and a group of primary care physicians. Clinical evaluators assessed AMIE across core competencies: history-taking thoroughness, diagnostic accuracy, management appropriateness, and communication quality.
What can AMIE do that text-based medical AI cannot?
AMIE interprets visual and auditory cues, guides virtual physical exams, and reasons diagnostically in real time — capabilities that allow it to observe physical signs like cough and gait, similar to how physicians conduct in-person consultations.
When will AMIE be available for clinical use?
Google has not announced a deployment timeline. The company states that AMIE remains a research system and more research is needed before responsible real-world clinical deployment.
Google AI BlogRead Original Article

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articlePixieset hits 35% AI adoption by automating photo descriptions, not replacing photographers