AIToday
Large Language ModelsOpen-Source AIGIGAZINE AIPublished: Oct 29, 2026, 16:00 JST

Intelligence Index v5 widens closed-open gap to 13 points

Send on LINE
Intelligence Index v5 widens closed-open gap to 13 points

3 Key Points

  1. What happened

    Artificial Analysis launched Intelligence Index v5 with two new benchmarks and three upgrades, and for the first time the majority of the Index rests on private datasets. The gap between the top closed and top open model widened from 3 to 13 points, with Kimi K3.1 Pro at 46 versus Gemini 4 Carbon's 59.

  2. Why it matters

    A wider gap suggests the strongest proprietary models are pulling away from freely available ones, so teams planning around open models face a larger measured capability shortfall than the previous version showed.

  3. What to watch

    Kimi K3.1 Pro has not yet been released and is scheduled to be published free of charge soon.

WHO IT HITSEnterprise teams choosing between proprietary and open models, and open-source maintainers who benchmark against closed systems, now see a 13-point gap rather than 3 in the headline measure.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

Intelligence Index v5 marks a structural change in how the composite is assembled, not just a reshuffling of scores. By building most of the Index on private datasets, Artificial Analysis reduces the chance that model makers tune against the exact questions being asked, which matters for anyone treating the ranking as an independent check rather than a marketing number. The two additions point in different directions: FrontierCode 2.0, contributed by Cognition, deliberately gives models vaguely specified prompts so that judgment, not just spec-following, is measured, while Terminal-Bench-Science puts 70 agentic research tasks in terminal environments.

The score movements cut both ways. OpenAI's models are rated higher under v5, while some models that ranked well in v4.3, including Meta's Muse Wonder Full(max) and Kimi K3 Pro, have slipped. On the new benchmark results, Claude Opus 5.5 (max) leads FrontierCode 2.0 with GPT-6 Astra (max) second and Gemini 4 Carbon sixth, whereas Gemini 4 Carbon tops Terminal-Bench-Science.

The headline consequence is the closed-versus-open spread, which grew from 3 points to 13. The top open model at the time of writing is Kimi K3.1 Pro at 46, well below Gemini 4 Carbon's 59, and that model has not yet been publicly released; it is expected to be published free of charge soon, so the open-side figure may shift once it is broadly available.

FAQ
What is new in Intelligence Index v5?
It adds two benchmarks, FrontierCode 2.0 for coding tasks and Terminal-Bench-Science for 70 agentic science tasks run in terminal environments, plus three upgrades. It is also the first version where the majority of the Index is built on private datasets.
Which models lead the new benchmarks?
Claude Opus 5.5 (max) ranks first on FrontierCode 2.0 with GPT-6 Astra (max) second, while Gemini 4 Carbon ranks sixth overall. On Terminal-Bench-Science, Gemini 4 Carbon takes first place.
Is the top open model available to use?
Not yet. Kimi K3.1 Pro, the top open model at 46, has not been released and is scheduled to be published free of charge soon.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articlexAI's MZX buys Southaven homes to kill noise suit