AIToday
Large Language ModelsVideo GenerationAudio & Speechnote AIPublished: Nov 2, 2026, 16:00 JST

Google DeepMind unveils Genie 4 world model with native audio

Send on LINE
Google DeepMind unveils Genie 4 world model with native audio

3 Key Points

  1. What happened

    Google DeepMind announced Genie 4 on October 27, 2026, a real-time world model that natively generates ambient sound, music and in-world dialogue, and can be steered with keyboard movement and text prompts.

  2. Why it matters

    Native audio and dialogue make the generated world something you can talk to and hear, not just watch. The demo videos are official highlights and no third-party evaluation, resolution, fps or pricing has been published, so practical cost and latency remain unclear.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

Genie has moved from a research demo to a platform in under three years. The first Genie, announced in February 2024, generated playable 2D worlds from an image. By August 2025, Genie 3 could be walked around in real time at 720p and 24fps, holding visual memory for about a minute. That progression explains why Genie 4's native audio and dialogue are a bigger step than a prettier picture: the model now produces a world you can hear and address, not just watch.

The architectural bet is a division of labor. Genie 4 renders pixels and sound, while a Gemini model acts as an in-loop guide that watches the scene, breaks goals into steps and decides whether each step succeeded. Google DeepMind calls this a first step toward a "hybrid world model" that combines language-model reasoning with pixel-level representation. If it works, the same setup could let a language model direct a simulated environment for robot training or scenario testing without hand-coding every scene.

What the announcement leaves open is how much that costs. Google has not published resolution, fps, generation time, latency or pricing for Genie 4, so the 720p, 24fps and few-minute figures from Genie 3 should not be assumed to carry over. For teams planning work, the practical signals will be the API's price and latency, the first independent reports of long-session behavior, and whether the promised early access actually opens beyond trusted testers.

FAQ
What is new in Genie 4 compared with Genie 3?
Genie 4 natively generates sound, including ambient audio and in-world dialogue, and adds a Gemini model inside the loop that breaks goals into steps and checks each frame. Genie 3 offered 720p at 24fps and kept visual memory for about one minute; Genie 4 has no published resolution, fps or generation-time figures.
Can I try Genie 4 now?
Not yet. Genie 4 is currently available only to trusted testers. User access through Project Genie, the Gemini API and Google AI Studio is listed as coming soon, and a waitlist is open.
What are Genie 4's known limitations?
Google DeepMind says short sessions stay consistent, but longer runs can drift in detail and object permanence, especially after multiple prompt edits or moving around a scene. Complex physics, audio accuracy, legible text, spatial accuracy and long-term consistency remain research topics.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleVOLTA malware uses AI to grade victims' financial value