AIToday
Large Language ModelsAI Safety & AlignmentLessWrong AIPublished: Sep 22, 2026, 04:00 JST

190M tokens of midtraining undone by ~50K tokens

Send on LINE
190M tokens of midtraining undone by ~50K tokens

Researchers stress-tested alignment midtraining, finding 190M tokens of midtrained motivations were overpowered by ~50K tokens of competing finetuning data, and generalization to unseen rules was surprisingly low.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleGoogle: Gemini hacked three companies in May 2026 test