AIToday
Large Language ModelsVideo GenerationRoboticsIEEE Spectrum RoboticsPublished: Oct 17, 2026, 04:00 JST

Google DeepMind's Gemini 4 Argon turns cornhole video into Apollo 2's seven straight shots

Google DeepMind's Gemini 4 Argon turns cornhole video into Apollo 2's seven straight shots

3 Key Points

  1. What happened

    In an internal test, Google DeepMind robotics researchers instructed Gemini 4 Argon to watch a video of a human playing cornhole. Using its video understanding and advanced reasoning, Gemini 4 built a virtual simulation in MuJoCo and calculated the physics and whole-body control for Apptronik's Apollo 2 humanoid to sink seven consecutive shots in the real world.

  2. Why it matters

    The test shows Gemini 4 Argon can turn an ordinary video into the physics and control calculations a physical robot needs, compressing weeks of manual modeling into a few hours and creating an infinite training ground for physical AI, according to Google DeepMind.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

Google DeepMind's internal test sits alongside other robotic milestones in this week's roundup, including NASA's Perseverance rover setting an off-world driving record on Oct. 11, 2026, and the European Space Agency rehearsing the Rosalind Franklin rover's first journey off its lander on Earth. The common thread is the difficulty of moving robots from prepared settings into unstructured ones: Perseverance covers Martian ground slowly, DEEP Robotics' M20S navigates China's Ailao Mountains, and ETH Zurich's WildOS searches unmapped outdoor terrain. Google DeepMind's claim that its pipeline compresses weeks of manual modeling into a few hours points at the same problem from the software side, where the bottleneck has been building accurate simulations by hand. Whether a single internal cornhole test generalizes to other tasks and other robots remains to be seen, since no results beyond this one demonstration are offered.

FAQ
What did Gemini 4 Argon actually do in the cornhole test?
It watched a video of a human playing cornhole, then built a virtual simulation in MuJoCo and calculated the physics and whole-body control needed for Apptronik's Apollo 2 humanoid to sink seven consecutive shots in the real world.
Why does this matter for training robots?
According to Google DeepMind, this Video-to-Sim-to-Real pipeline compresses weeks of manual modeling into a few hours, transforming ordinary videos into an infinite training ground for physical AI.
What other robotics news and events are mentioned?
NASA's Perseverance rover became the off-world distance record-holder on Oct. 11, 2026, and the calendar lists CoRL 2026 and Humanoids 2026.
IEEE Spectrum RoboticsRead Original Article

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleOpenAI agents broke out and hacked Hugging Face, not just "glitched"