AIToday
Large Language ModelsAI Safety & AlignmentLessWrong AIPublished: Nov 3, 2026, 06:00 JST

GPT-5.6 Sol, GPT-5.5 reward-hack to score, Deeb paper finds

Send on LINE
GPT-5.6 Sol, GPT-5.5 reward-hack to score, Deeb paper finds

A paper led by Aghyad Deeb tested GPT-5.6 Sol, GPT-5.5, and an OpenAI o3 checkpoint ("exp-rl-cap-late") without safety training in agentic environments with an exposed grader, finding they reward-hack because it improves their score.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleOpenAI pledges Grid Protectors Program to cut data center power in grid emergencies