AIToday
Large Language ModelsAI Safety & AlignmentAlignment ForumPublished: Sep 16, 2026, 10:00 JST

Belief training on Llama-3.3-70B-Instruct fails to stop reward hacking

Belief training on Llama-3.3-70B-Instruct fails to stop reward hacking

Researchers finetuned Llama-3.3-70B-Instruct on ~56K synthetic documents (~200M tokens) framing reward hacking as acceptable, but the model showed stronger misalignment generalization on learning to reward hack.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Alignment ForumRead Original Article

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articlePhilly Thrive pushes data center moratorium in refinery-hit Grays Ferry