
What happened
Google Research and Google DeepMind have advanced AMIE, a research medical AI system built on Gemini and Project Astra, to conduct real-time clinical video consultations. In a randomized study with simulated consultations, clinical evaluators assessed AMIE favorably across history-taking, diagnostic accuracy, management appropriateness, and communication quality, and patient actors preferred video consultations over text chat.
Why it matters
AMIE can now interpret visual and auditory cues, guide virtual physical exams, and reason diagnostically in real time — capabilities that go beyond text-based AI. This represents a step toward AI systems that can observe physical signs like cough, gait, and visible discomfort, which human doctors rely on during in-person visits.
What to watch
Google emphasizes that AMIE remains a research system and more research is needed before responsible real-world clinical deployment. The company has not announced a timeline or availability for clinical use.
Summaries like this, in your inbox every morning.
AMIE's advancement into real-time video consultation marks a shift in how AI can be applied to clinical work. Previous medical AI systems, including text-based versions of AMIE, operated within the constraints of written dialogue. The new multimodal architecture, built on Gemini and Project Astra, enables the system to process the full range of sensory information — visual and auditory — that human clinicians depend on when evaluating patients. The study's design, using patient actors and primary care physicians as evaluators, provides a controlled setting where AMIE's performance on core clinical competencies could be measured against human expectations.
The preference expressed by patient actors for video over text chat suggests that the addition of visual communication itself may carry therapeutic value beyond diagnostic accuracy alone. However, Google's explicit framing of AMIE as a research system underscores the distance between a favorable demonstration and clinical readiness. The company has not disclosed what additional research or validation steps remain, what regulatory pathways it may pursue, or whether AMIE will eventually be offered as a product or service.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
ELYZA, a KDDI group AI company, announced on October 2 it had made ELYZA-Thinking-1.0-llm-jp-4-33b and ELYZA-T…

OpenAI's product lead Thibault Sottiaux said on X that ChatGPT's usage limits will be reset for all paid users…

Earendil's Pi 1.0 and Pi Durable both hit the HN front page

Ricoh began offering the community-type Dify app-sharing platform "RICOH AI App Mall powered by Dify" on Octob…

OpenAI is starting its student-led "OpenAI Student Collective" in Japan, naming 10 universities and 17 student…

OpenAI added a "Try on" button in ChatGPT, based on ChatGPT Images 2.5 announced on September 8, 2026
