AIToday
AI Safety & AlignmentLessWrong AIPublished: Aug 24, 2026, 13:00 JST1 min read

Roy Fox proposes utility-probability duality via Legendre transform

Roy Fox proposes utility-probability duality via Legendre transform

Key takeaway

  • Roy Fox proposes a new framework for agent capability.

  • It links probabilities and utilities through the Legendre-Fenchel transform.

  • This could help in AI alignment by clarifying what agents can achieve.

3 Key Points

  1. What happened

    Roy Fox proposes understanding an agent's capabilities by the set of environment dynamics it can bring about, leading to a duality between probabilities and utilities via the Legendre-Fenchel transform.

  2. Why it matters

    This offers a new way to delineate agent capabilities, which is important for AI alignment, as it reframes capability in terms of achievable outcomes rather than just maximizing expected utility.

  3. What to watch

    The implications for describing and comparing agent power, and whether this formal approach can be applied to practical alignment challenges.

Ask the AI about this article →

Context & Analysis

The article presents a theoretical proposal by Roy Fox, not an experimental result. It builds on reinforcement learning, where behavior is seen as expected utility maximization. Fox's idea is to define capability by the set of environment dynamics an agent can bring about, which is a shift from focusing on reward functions. This leads to a mathematical duality via the Legendre-Fenchel transform, linking probabilities and utilities. For AI alignment, this could offer a clearer way to specify and compare what agents are capable of achieving, potentially helping to ensure their behavior aligns with human values. However, the article is a TLDR, so details are limited, and it is a framework proposal, not a validated method. Its significance lies in providing a new perspective on agent capability, which is a central concern in alignment research.

FAQ

What does the Legendre-Fenchel transform do in this context?
It establishes a duality between probabilities and utilities, allowing capabilities to be described in terms of the set of environment dynamics an agent can bring about.
How does this relate to reinforcement learning?
It builds on RL's view that behavior arises from maximizing expected utility, but expands capability to include the range of reward functions an agent can maximize.

Get the latest AI Safety & Alignment news every morning

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytime

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleAnonymous coding model Ox Alpha appears, origin unknown