AIToday
Large Language ModelsLessWrong AIPublished: Aug 4, 2026, 01:01 JST

New AI models show major gains on single-pass reasoning evals

New AI models show major gains on single-pass reasoning evals

Researchers replicated reasoning evaluations from prior work on Opus 4.5, then tested three newer models—Claude Fable 5, Opus 5, and GPT-5.6-Sol—using single-forward-pass evaluation methods. Fable 5 achieved 87.6% accuracy on Gen-Arithmetic with 10 problem repeats (compared to previous best around 60%), and GPT-5.6-Sol showed substantial uplift from filler tokens and problem repeats across datasets, with performance roughly doubling on the 3-hop task.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleAI worms now self-replicate using stolen GPUs; researchers warn of autonomous threats