EdgeBench is a benchmark developed by Bytedance Seed that measures how well AIs improve on tasks after multiple tries, with automated feedback. It includes 134 tasks across domains like data analysis, math proofs, and video games.

Does the trend apply to all AI tasks?

No. EdgeBench does not measure performance on tasks without clear reward signals, such as much of real-world human labor.

Large Language ModelsAI Safety & AlignmentML Safety NewsletterAug 26, 2026Aug 27, 2026, 04:01 JST

New benchmark shows AI learning speed doubles every 3 months

Send on LINE

3 Key Points

What happened
Researchers from Bytedance Seed developed EdgeBench, a benchmark measuring how AIs improve on tasks over multiple tries. It comprises 134 tasks, each requiring an average of 57.2 hours of human expert work, with scores given on a rubric from 0% to 100%.
Why it matters
The researchers claim that, using their measurement, AI task-learning speed doubles every 3 months, potentially improving roughly 16x per year. This suggests explosive capability growth across domains like data analysis, math proofs, and video games, though it doesn't measure performance on tasks without clear reward signals.
What to watch
The ability to iterate and improve is useful for recursive-self improvement (RSI), which could accelerate AI development and remove human control. AI agents have already launched autonomous cyberattacks worth potentially $100 million in remediations, relying significantly on iteration over weeks.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Get news like this every morning, free

Context & Analysis

Existing benchmarks primarily check if AIs can complete tasks on the first try. EdgeBench instead scores how AIs improve over many attempts, building experience with automated feedback. This approach better distinguishes model capabilities and forecasts future development, as it includes tasks current AIs cannot solve initially.

The measured doubling of learning speed every 3 months has significant implications. Faster autonomous learning enables recursive self-improvement (RSI), where AIs develop AI, accelerating progress and potentially reducing human oversight. Even without RSI, iterated learning has real-world impact: AI agents have already launched autonomous cyberattacks relying on weeks of iteration, worth up to $100 million in remediations. EdgeBench could serve as a leading indicator for such offensive capabilities.

FAQ

What is EdgeBench?: EdgeBench is a benchmark developed by Bytedance Seed that measures how well AIs improve on tasks after multiple tries, with automated feedback. It includes 134 tasks across domains like data analysis, math proofs, and video games.
Does the trend apply to all AI tasks?: No. EdgeBench does not measure performance on tasks without clear reward signals, such as much of real-world human labor.

ML Safety NewsletterRead Original Article

Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Get it free

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.