
Google's Gemini now analyzes videos by selecting key moments itself.
Token use drops by 88% on benchmarks while accuracy edges up.
The feature works from 10-minute tutorials to multi-hour recordings.
What happened
Google added agent-based video analysis to Gemini 3.7 Flash, 3.6 Flash, and 3.5 Flash-Lite. Instead of sampling every frame per second, the model picks relevant sections on its own.
Why it matters
On Google's 1H-VideoQA and LVBench benchmarks, token usage drops 88% while accuracy improves slightly. This lowers cost for developers and supports tasks like finding anomalies or counting repeated motions in hours of footage.
What to watch
The feature is live through the Gemini API with no extra fee, and it will roll out to all Gemini app users on Flash and Flash Lite soon. Later, it will power "Ask YouTube" on the playback page.
Ask the AI about this article →
This update refines Google's earlier move into "agentic vision," which shipped for Gemini 3 Flash in January. That feature let the model write and run Python to edit images, checking results in a loop. Now the same principle applies to video. The model decides which parts of a video to inspect, through frames, audio, or transcript, and retrieves only what it needs, cutting token use by up to 88% on benchmarks like 1H-VideoQA and LVBench.
The practical payoff is accuracy on small details, such as state changes or cuts shorter than one second, which static per-second sampling could miss. Google also reports that on LongVideoBench, Gemini 3.7 Flash leads in overall quality and cost efficiency, suggesting the agent-based approach is not just cheaper but often more precise.
Google says the feature will reach all Gemini app users on Flash and Flash Lite soon, with "Ask YouTube" integration following over the coming months. Because the API charges standard token rates with no extra fee, the cost savings could make sophisticated video analysis more accessible to developers.
For example, today's edition would include:
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. Q&As are published on this page for other readers too.
Nvidia invested $3.5 billion in MediaTek, a Taiwanese chipmaker, to help customers build custom AI chips that…

Semafor and Riddance AI uncovered a network of about a dozen YouTube channels using real actors with AI-genera…

At a recent ICRA panel, robotics researchers discussed how to handle the overwhelming number of publications

Anthropic released Claude Fable 5.1 and Claude Mythos 5.1 as its new flagship models

Winamp Group's subsidiary Jamendo SA amended its U.S

Anthropic’s annualized revenue run rate topped $65 billion in July, seven times its year-ago level
