Researchers introduced CoFi-PGMA, a framework for training multiple language models that either compete through routing mechanisms or collaborate to produce answers, addressing the problem that standard reinforcement learning objectives become misspecified when learning signals are filtered by system mechanisms.
The approach derives per-agent training objectives based on marginal contribution: for routing systems it applies off-policy corrections for selection-gated feedback, while for collaborative systems it uses leave-one-out difference rewards for credit assignment (a method that measures each agent's individual contribution by comparing performance with and without that agent).
The framework analyzes how softmax routing induces risk-sensitive incentives and provides practical training algorithms that integrate counterfactual estimators, multiturn-aware rewards, and policy optimization methods, with demonstration on a real-world reasoning dataset.
Summaries like this, every morning.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
At Open Source Summit Europe 2026 in Prague, a Texas Instruments-moderated panel said embedded engineers are b…

On the Nov. 19 earnings call, CEO John Furner said U.S

On a Q3 2027 earnings call, CEO John Furner said Walmart is preparing its omnichannel experience for internal…

On the Nov 18, 2026 earnings call, CEO Marvin Ellison said Lowe's AI shopping assistant Mylow answers over a m…

In an article by SoftBank engineer Shinya Shikishima, the company laid out four reasons LP gas delivery is har…

Amazon added AI agents to AWS Marketplace that find products, review contract terms, check vendor security and…
