AIToday
Large Language ModelsTHE DECODERPublished: Oct 17, 2026, 01:00 JST

Gemini 4 Argon passes 95% on ARC-AGI-3, second after OpenAI

Gemini 4 Argon passes 95% on ARC-AGI-3, second after OpenAI

3 Key Points

  1. What happened

    Google Deepmind's Gemini 4 Argon scored 97.5 percent on ARC-AGI-3 at a cost of $4,800, second only to GPT-6 Astra's 99.9 percent, per ARC Prize.

  2. Why it matters

    Google is now the second lab to cross 95 percent on a benchmark widely seen as the toughest test of general problem-solving, putting it near the frontier.

WHO IT HITSGoogle's enterprise customers and AI procurement teams weighing Gemini against OpenAI for complex reasoning tasks now have a benchmark result that puts Argon near the top, though math and coding rankings remain a caveat.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

Google Deepmind's Gemini 4 Argon arrives at a moment when benchmark scores are increasingly contested. The model's 97.5 percent on ARC-AGI-3 came using the Provider Adapter Harness, which relies on vendor-specific features like retained reasoning and context compaction. Under the standard testing harness, the score falls to 49.8 percent, a gap that traces back to a July 2026 dispute over how different API settings affect results. That context matters because it shows how much benchmark outcomes can shift based on the testing setup rather than the model alone.

Epoch AI's tracking places Argon at 165 points on its Epoch Capabilities Index, tying Fable 5.1 and sitting just behind Opus 5.5 (167) and GPT-6 Astra (166). This is the closest Google has been to the frontier since Gemini 3.1 Pro in February 2026, well ahead of Gemini 3.8 Flash (157 points). But the gains are uneven: early estimates rank Argon eighth on the Math ECI and sixth on the Software Engineering Index, suggesting coding and math remain weaker spots even as knowledge, agent, and vision benchmarks improve.

FAQ
How much does it cost to run Gemini 4 Argon on the ARC-AGI-3 benchmark?
The test cost $4,800 using the Provider Adapter Harness. In the Standard Harness at low reasoning, it cost $5,800.
How does Gemini 4 Argon compare to other models on Epoch AI's capability index?
Argon scored 165 points on the Epoch Capabilities Index, tying Fable 5.1 and landing just behind Opus 5.5 (167) and GPT-6 Astra (166).
Where does Gemini 4 Argon rank in math and software engineering?
Early estimates put it in eighth on the Math ECI and sixth on the Software Engineering Index (SWE ECI), according to Epoch AI.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleSurface Laptop Ultra hits $2,599 with RTX Spark