AIToday
Video GenerationTHE DECODERPublished: Sep 20, 2026, 22:00 JST

Runway pushes real-time AI video with GWM-1

Runway pushes real-time AI video with GWM-1

3 Key Points

  1. What happened

    Runway shared research into real-time video generation, where users stream video as they describe it rather than waiting for a finished clip.

  2. Why it matters

    Runway says users repeatedly report losing the most time generating and revising videos, and it argues real-time generation closes the gap between an idea and its execution.

  3. What to watch

    Runway hasn't announced a timeline for availability, so the approach hinges on whether the model can produce each frame fast enough for playback while shared across several sessions.

WHO IT HITSVideo creators and creative teams who iterate on clips stand to lose less time to generating and revising, while Runway's plans for robotics and autonomous driving could affect engineers training robot and vehicle systems in simulated environments.

Not sure about something? Ask the AI

Summaries like this, in your inbox every morning.

Context & Analysis

Runway first discussed this real-time approach in March with Runway Characters, and it uses GWM-1, the company's first "General World Model," which Runway introduced in December 2025. GWM-1 builds on Gen-4.5, generates video frame by frame, and accepts camera movements, robot commands, or audio as controls. Just a few weeks ago, Runway showed Solaris, a system that uses Gen-4.5 to generate user interfaces frame by frame. In March, Runway also showed a research preview of a real-time model developed with Nvidia at the chipmaker's GTC conference, running on the Vera Rubin platform and designed to deliver the first frame in under 100 milliseconds.

Runway argues that real-time generation shifts the compute load from training to use, with the model needing to produce each frame fast enough to keep up with playback while running on hardware shared by several sessions at once. It also points to lower costs, saying faster models use less GPU time, and that the cost per output at a given quality level determines which applications make economic sense. Runway sees interactive applications as the biggest long-term use case for AI-generated media, citing education, gaming, and robotics, and it previously introduced GWM Robotics, a variant of GWM-1 that generates synthetic training data for robots.

The outcome appears to hinge on whether Runway can deliver frames fast enough for smooth playback while multiple sessions share the same hardware, and on whether cost per output drops low enough to make previously unprofitable applications viable. For video creators, the appeal is less time generating and revising clips; for robotics and autonomous driving teams, the appeal is environments that respond instantly to edge cases. Runway hasn't announced a timeline for availability.

FAQ
What is GWM-1?
GWM-1 is Runway's first "General World Model," introduced in December 2025. It builds on Gen-4.5 and generates video frame by frame, accepting camera movements, robot commands, or audio as controls.
How does Runway plan to handle errors that build up over time in video generation?
Runway says a video model builds each frame on the previous one, allowing small errors to compound into major distortions. It addresses this by training the model on its own outputs rather than only error-free inputs, teaching it to correct its own deviations instead of amplifying them.
Who else is working on real-time or interactive video generation?
Startup Decart used a similar approach for its real-time model MirageLSD, and Google Deepmind says its world model Genie 3 keeps interactive worlds consistent for several minutes at 24 frames per second in 720p. Waymo is taking a similar approach with the Waymo World Model, based on Genie 3 and adapted for road traffic.

Get the latest Video Generation news every morning

For example, today's edition would include:

  • Level-5 draws steady TGS 2026 crowd despite AI backlashITmedia AI+ · 2d ago
  • Tilly Norwood, Particle6's AI actress, faces CNN, NBC, CBS pressr/artificial · 2d ago
  • Level-5 chief Akihiro Hino apologizes for AI videoTop Companies AI · 2d ago

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleHilton CHRO Laura Fuentes: AI fuels 12,000 applicants for 72 internships