AIToday
Large Language ModelsAI Business & IndustryTHE DECODERPublished: Nov 6, 2026, 04:00 JST

SemiAnalysis' GDPx puts AI agents to work; Claude Opus 5.5 leads at 12 percent

Send on LINE
SemiAnalysis' GDPx puts AI agents to work; Claude Opus 5.5 leads at 12 percent

3 Key Points

  1. What happened

    SemiAnalysis released GDPx, a benchmark with 206 tasks across eleven domains like chip design and law. Claude Opus 5.5 tops it at 12 percent; Gemini 4 Carbon follows at 10.9 percent for $16.29 per task.

  2. Why it matters

    The low scores suggest today's AI agents struggle with realistic knowledge work, which may temper expectations for near-term automation and AI revenue.

WHO IT HITSEnterprise teams evaluating AI agents for knowledge work such as chip design or legal analysis may find the benchmark's low scores a caution against overestimating current capabilities. AI labs selling agent products could face tougher scrutiny of real-world performance claims.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

SemiAnalysis designed GDPx to differ from OpenAI's GDPval by providing a realistic work environment rather than delivering all context in the prompt. The benchmark's 206 tasks span eleven domains, intentionally excluding administration and insurance, because the team argues the first trillion dollars in AI revenue will come from industries where frontier AI delivers the biggest returns. The results show a narrow spread at the top: Claude Opus 5.5 leads at 12 percent, with Gemini 4 Carbon close behind at 10.9 percent but at roughly a third of the cost per task ($16.29). GPT-6 Astra scores 9.6 percent. A filtered analysis reveals that provider safety mechanisms can reshuffle rankings: without the cyber, biology, and alignment domains, GPT-6 Astra edges past Opus 5.5 at 11.8 percent. The secrecy of the tasks, which come from 14 specialized partners, is intended to prevent labs from optimizing for the test, but critics like developer Josh Purtell call GDPx "more noise than signal," citing provider-specific agent software and small sub-domain sample sizes as sources of volatility.

FAQ
What is GDPx?
GDPx is a benchmark from SemiAnalysis that places AI agents in simulated work environments for up to eight hours, using professional software and data rooms.
Which model performs best on GDPx?
Claude Opus 5.5 leads at 12 percent, followed by Gemini 4 Carbon at 10.9 percent and GPT-6 Astra at 9.6 percent.
How much does it cost to run a task?
Gemini 4 Carbon costs $16.29 per task, about a third of the price of Claude Opus 5.5. GPT-6 Luna and DeepSeek 4.1 Flash cost roughly a dollar per task.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleSkyPSI's Vic Pellicano on Drone Radio Show: drone cleaning as a business