AIToday
Large Language ModelsAI Coding AssistantsZenn AI/MLPublished: Oct 9, 2026, 10:00 JST

HyperFrames: one prompt to Claude Code yields a 20-second MP4

HyperFrames: one prompt to Claude Code yields a 20-second MP4

HyperFrames, HeyGen's open-source (Apache 2.0) video tool, turns an HTML file into MP4 using headless Chrome and FFmpeg; one prompt to Claude Code produced a 1920×1080, H.264, 20.0-second video in about 6 minutes.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The walkthrough is built around how HyperFrames splits labor: the AI writes only the HTML, while the tool handles rendering to video. HyperFrames is positioned from the start for coding agents — its README headline reads "Write HTML. Render video. Built for agents." — and three roles are distinguished: the person who asks in one sentence and checks the output, the AI that writes the HTML and assembles parts, and HyperFrames itself, which captures frame by frame in a browser and combines them with FFmpeg.

In practice, the AI did not start writing HTML immediately. It read the skill installed by init, searched the official component catalog, added five blocks (including code-terminal-run and count-up), ran a check, and took snapshot frames before rendering. That scaffolding — a catalog, instructions, checks, and frame samples — is what separates this from simply having the AI write an FFmpeg script.

Caveats are practical rather than technical. The template loads GSAP and fonts from external CDNs at render time, so an offline or restricted network fails unless you vendor them locally. The built-in text-to-speech produced Japanese the author could not understand, so supplying your own audio file is advised. Licensing also matters for commercial use: bundled sound effects are declared under the Pixabay Content License, and one music-generation route, MusicGen, has model weights under CC-BY-NC 4.0 (non-commercial) — though the BGM here was synthesized by the AI with FFmpeg, avoiding that issue.

FAQ
Do I need a HeyGen account to use HyperFrames?
No. You can create and render locally without an account, and the author completed the whole workflow without signing in or setting HEYGEN_API_KEY. Signing in is only needed for things like HeyGen voices, music, managed cloud rendering, hosted MCP, or updating a published project.
What do I need installed before I start?
Per the README as of 2026-10-05, you need Node.js 22 or higher and FFmpeg, plus a Chrome for rendering. If you don't have one, npx hyperframes browser ensure can find or fetch it, and npx hyperframes doctor checks your environment.
Why should I check the rendered video myself?
The tool can change things you did not ask for. In one test, adding a line of text pushed the heading up about 100px, and it was only visible by comparing frames at the same timestamp. Some of these changes were not mentioned in the AI's report.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleHex cuts wrong edits 7x with evals on Quick Edits