AIToday
Large Language ModelsVideo GenerationAudio & Speechnote AIPublished: Nov 4, 2026, 01:00 JST

Google DeepMind unveils Genie 4 with native audio

Send on LINE
Google DeepMind unveils Genie 4 with native audio

3 Key Points

  1. What happened

    Google DeepMind announced Genie 4 on 2026年10月27日, billed as its first real-time world model that natively generates sound — wind, waves, music and changing dialogue — together with video.

  2. Why it matters

    That audio is produced natively inside the model, as the company puts it, rather than by generating video and sound separately and syncing them afterward — though how it works internally has not been disclosed.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

Genie 4 arrives as the fourth generation in a line that began in March 2024 and moved through Genie 2 in December of that year to Genie 3 on August 5, 2025. Genie 3 was introduced as a general-purpose world model that generates diverse interactive environments from text, and it supported real-time operation at 720p and 24fps with visual memory of about one minute. In January 2026, an early-access version called Project Genie was offered to U.S. residents aged 18 and over who subscribe to Google AI Ultra, with sessions limited to 60 seconds of world exploration.

Beyond the audio capability, DeepMind describes Genie 4 as built on the Gemini family: Gemini Omni is said to ground the simulation in real-world appearance and behavior, while Gemini 3.8 Flash serves as a guide agent that observes scenes, divides goals into steps, checks frames, and replans when the world changes or the user intervenes. DeepMind research director Tejas Kulkarni said at a press briefing that "hybrid world models" — in which Gemini writes code and text while Genie simulates reality — are likely to become more common.

This division of labor resembles the plan-act-check loop familiar from AI agents: one side generates video and sound, the other plans and supervises. However, it remains unclear from public information whether Gemini Omni and Gemini 3.8 Flash are embedded inside the Genie model or direct it from outside, or how the components are connected.

FAQ
What makes Genie 4 different from previous Genie models?
Genie 4 adds native sound generation — ambient sound, music, and dialogue — to the real-time interaction of earlier models. Google DeepMind describes it as its first real-time world model that natively generates audio.
Can users edit the simulated world while it is running?
Yes. Users can change the weather, move the camera, or introduce new people and objects by giving instructions in natural language during the simulation.
How is Genie 4 built and when can people use it?
Google DeepMind says Genie 4 draws on the Gemini family, with models such as Gemini Omni grounding the simulation and Gemini 3.8 Flash acting as a guide agent inside the generation loop. The company has not disclosed the model's internal structure or a public release date.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articlePrecision vs Recall: author's mnemonic memo via オオカミ少年 and praecidere