AIToday

OpenAI's GPT-5.5 achieves 71.4% pass rate on expert-level cybersecurity tasks, matching performance gains seen in Anthropic's Claude Mythos Preview

Hacker NewsMay 4, 20262 min read
OpenAI's GPT-5.5 achieves 71.4% pass rate on expert-level cybersecurity tasks, matching performance gains seen in Anthropic's Claude Mythos Preview

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  1. GPT-5.5 reached an average pass rate of 71.4% (±8.0%) on expert-level advanced cyber tasks, compared to 68.6% (±8.7%) for MythosPreview, 52.4% (±9.8%) for GPT-5.4, and 48.6% (±10.0%) for Opus 4.7, making it potentially the strongest model tested on this benchmark.

  2. The evaluation uses a suite of 95 narrow cyber tasks in capture-the-flag format across four difficulty tiers, testing vulnerability research, reverse engineering, web exploitation, and cryptography; basic-tier tasks have been saturated by models since at least February 2026, while advanced tasks probe realistic targets with modern mitigations.

  3. In a single complex task (rust_vm challenge), GPT-5.5 solved a stripped Rust binary reverse-engineering problem requiring custom virtual-machine disassembly and password recovery in 10 minutes and 22 seconds at a cost of $1.73 (USD) in API usage, compared to roughly 12 hours for a human expert using Binary Ninja, gdb, Python, and Z3.

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →