AIToday

Turing Award winner Sutton launches Oak Lab to build self-learning AI agents

THE DECODER3h ago
Turing Award winner Sutton launches Oak Lab to build self-learning AI agents

Key takeaway

Richard Sutton, winner of the 2024 Turing Award, has founded Oak Lab in Toronto to develop AI agents that learn and improve continuously on their own, rather than relying on static training datasets. Sutton contends that today's generative AI models are fundamentally limited because they can imitate but cannot evaluate their own outputs or discover new knowledge. Oak Lab aims to build agents with internal world models that handle their own evaluation and selection in real time, targeting an agent with a trillion parameters operating on just 20 watts of energy.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  • What happened

    Richard Sutton, who won the 2024 Turing Award and co-founded modern reinforcement learning, has started Oak Lab in Toronto with Khurram Javed. Both previously worked at John Carmack's Keen Technologies. Sutton says current deep learning methods are "weak and inefficient" and require "fundamentally new ideas" rather than incremental fixes.

  • Why it matters

    Sutton argues that generative AI can imitate but cannot evaluate its own outputs or achieve real discovery. Oak Lab's approach—building agents that learn continuously from their environment, construct internal world models, and handle evaluation on their own—represents a different strategy from today's static training. For businesses and developers, this may indicate an emerging alternative to current large-language-model approaches.

  • What to watch

    Oak Lab's long-term goal is an agent with "a trillion parameters that learns and plans in real time with 20 watts of energy." The company, like Keen before it, bets on reinforcement learning—training AI from live experience rather than once on fixed datasets.

Context & Analysis

Richard Sutton's launch of Oak Lab reflects a growing critique of large-language-model paradigms that dominate AI today. Sutton, whose foundational work on reinforcement learning underpins much of modern AI, has become increasingly vocal about the limits of current approaches. In June, he articulated a specific gap: generative AI excels at imitating patterns from training data but lacks the ability to assess the quality of its own outputs or perform genuine discovery—a constraint that matters enormously for AI systems that must operate independently in changing environments.

Oak Lab's design directly addresses this gap by targeting reinforcement learning—the paradigm where AI improves by interacting with an environment and receiving feedback, rather than fitting to a fixed training set once. This is not a new idea in principle, but Sutton's framing suggests a conviction that current deep learning methods, despite their scale, lack the architectural and conceptual foundations needed for agents that can truly learn and adapt in real time. The emphasis on internal world models—systems that let an AI understand and predict how its environment behaves—and on energy efficiency (20 watts for a trillion-parameter agent) hints at a belief that the path forward is not simply scaling existing methods but rethinking them from the ground up.

FAQ

Who founded Oak Lab and what is their background?
Richard Sutton, the 2024 Turing Award winner and co-founder of modern reinforcement learning, launched Oak Lab with Khurram Javed. Both previously worked at John Carmack's AI company Keen Technologies.
How does Oak Lab's approach differ from current AI methods?
Sutton argues that current generative AI is good at imitation but cannot evaluate its own outputs or achieve real discovery. Oak Lab is building agents that learn continuously from their environment, construct internal world models, and handle evaluation and selection on their own—using reinforcement learning and learning from live experience rather than training once on static datasets.
What is Oak Lab's long-term goal?
The company aims to build an agent with a trillion parameters that learns and plans in real time with 20 watts of energy.

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →