AIToday

AI Futures Project releases normative 2040 scenario blueprint

LessWrong AI8h ago
AI Futures Project releases normative 2040 scenario blueprint

Key takeaway

The AI Futures Project has published AI 2040: Plan A, a normative blueprint for how society should prepare for a future with many powerful AI systems. Unlike their earlier AI 2027 forecast, this plan prescribes specific actions — including limiting intelligence gaps between AI systems deployed internally versus externally — and is drawing scrutiny from researchers evaluating whether the approach would actually achieve its goals or create unintended consequences.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  • What happened

    The AI Futures Project has released AI 2040: Plan A, described as a normative plan (prescribing what ought to be done) rather than a forecast. This follows their earlier AI 2027 scenario, which predicted what a future with many powerful AIs would look like.

  • Why it matters

    The plan addresses policy and governance for a world with advanced AI systems. It includes recommendations such as limiting the gap between the intelligence of internal and external model deployments — a measure intended to manage risks from powerful AI systems becoming widely available.

  • What to watch

    The plan faces both internal-consistency objections (whether it would achieve its own stated goals) and external critiques about whether pursuing it would harm other important values, according to observers reviewing the proposal.

In Depth

The AI Futures Project has published AI 2040: Plan A as a normative scenario for how society should approach a future with many powerful AI systems. The document represents a deliberate shift from the group's earlier AI 2027 work, which was framed as a forecast — an attempt to describe what the authors believed such a future would actually look like. AI 2040, by contrast, is explicitly normative: it describes what ought to be done, assuming that a future with multiple powerful AI systems is likely.

The plan includes what the authors call an "incremental AI policy wishlist" — a set of policy recommendations intended to be executed in the near term. One notable element focuses on limiting the intelligence gap between internal and external model deployments. In other words, the plan recommends efforts to narrow the difference in capability between AI systems that organizations use internally and those they deploy externally to the public. This recommendation reflects an underlying concern about asymmetries in AI access and control.

Early reviewers have identified substantive objections to the proposal on multiple grounds. Some objections are "within-frame" — meaning they accept the plan's stated goals but question whether the proposed steps would actually achieve them. Others reflect external value disagreements — concerns that pursuing AI 2040 would sacrifice or harm things the reviewers consider important, independent of the plan's internal coherence. The nature and weight of these objections remain under discussion within the AI policy and research community.

Context & Analysis

The AI Futures Project's release of AI 2040: Plan A marks a shift from forecasting to prescription. Where AI 2027 aimed to describe a plausible future with advanced AI systems, AI 2040 moves into the normative domain — arguing for specific actions policymakers and organizations should take now to navigate that future responsibly. The plan reflects growing concern in AI governance circles about the pace and distribution of AI capabilities. One of its core recommendations — managing the intelligence gap between internal and external deployments — reflects a concern that organizations may retain more powerful AI systems for internal use while deploying less capable versions externally, potentially widening asymmetries in capability and control.

The plan has already drawn critical attention. Reviewers have raised both internal-consistency objections (questioning whether the proposed steps would actually achieve the authors' stated goals) and substantive disagreements about whether pursuing the plan's recommendations would preserve other values observers care about. This suggests the proposal is being engaged seriously by the AI policy community, even as its merits remain contested.

FAQ

How does AI 2040 differ from the earlier AI 2027 scenario?
AI 2027 was a forecast describing what the authors thought a future with many powerful AIs would look like. AI 2040 is normative — it prescribes what one ought to do, given that such a future is likely.
What is one specific policy recommendation in AI 2040?
The plan includes an "incremental AI policy wishlist" recommending attempts to limit the gap between the intelligence of internal and external model deployments — the difference between AI systems used within organizations versus those deployed publicly.

Get the latest AI Regulation & Policy news every morning

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytime

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →