
What happened
SemiAnalysis released GDPx, a benchmark with 206 tasks across eleven domains like chip design and law. Claude Opus 5.5 tops it at 12 percent; Gemini 4 Carbon follows at 10.9 percent for $16.29 per task.
Why it matters
The low scores suggest today's AI agents struggle with realistic knowledge work, which may temper expectations for near-term automation and AI revenue.
WHO IT HITSEnterprise teams evaluating AI agents for knowledge work such as chip design or legal analysis may find the benchmark's low scores a caution against overestimating current capabilities. AI labs selling agent products could face tougher scrutiny of real-world performance claims.
Summaries like this, every morning.
SemiAnalysis designed GDPx to differ from OpenAI's GDPval by providing a realistic work environment rather than delivering all context in the prompt. The benchmark's 206 tasks span eleven domains, intentionally excluding administration and insurance, because the team argues the first trillion dollars in AI revenue will come from industries where frontier AI delivers the biggest returns. The results show a narrow spread at the top: Claude Opus 5.5 leads at 12 percent, with Gemini 4 Carbon close behind at 10.9 percent but at roughly a third of the cost per task ($16.29). GPT-6 Astra scores 9.6 percent. A filtered analysis reveals that provider safety mechanisms can reshuffle rankings: without the cyber, biology, and alignment domains, GPT-6 Astra edges past Opus 5.5 at 11.8 percent. The secrecy of the tasks, which come from 14 specialized partners, is intended to prevent labs from optimizing for the test, but critics like developer Josh Purtell call GDPx "more noise than signal," citing provider-specific agent software and small sub-domain sample sizes as sources of volatility.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
Hitachi Energy is expanding its partnership with Celonis, the process-intelligence leader, to scale AI use acr…

KJ Holdings, which runs the Kawaijuku Group, signed an MOU with Seoul-based IHFB in October 2026 to jointly st…

Spesia added an "AI consultation on data and measures" chat to Flowgent, its Amazon operations analysis system

For April–September 2026, Nomura Research Institute posted revenue of 4299億円, up 8% year on year, and operatin…

DXYZ and TIERO will run the 'Face-Only Shopping' demonstration for three days from November 21 to 23, 2026 at…

In Branding Works' October 2026 survey of ChatGPT and Gemini answers, 辻・本郷税理士法人 appeared in 50% of responses…
