AIToday
AI Safety & AlignmentLessWrong AIPublished: Sep 1, 2026, 06:01 JST1 min read

Weird AI safety projects need funding

Weird AI safety projects need funding

Key takeaway

  • The article urges funding for weird AI safety projects.

  • It says current strategies assume business as usual.

  • It argues radical options have a longer tail of upsides.

3 Key Points

  1. What happened

    An article argues that current AI safety funding strategies often assume 'business as usual' and calls for explicit substantial effort to fund more radical and abnormal projects and initiatives in AI safety.

  2. Why it matters

    Even under a model where most current AI safety work is useless, weird projects are worth funding because their higher variability gives them a longer and fatter tail of upsides, according to the article.

  3. What to watch

    The article suggests that even those without very short timelines or high p(doom) should agree that some timelines short enough or p(doom) high enough justify radical funding strategies.

Ask the AI about this article →

Context & Analysis

The article challenges conventional AI safety funding by arguing that it often assumes 'business as usual,' which may be inconsistent with the timelines and probabilities of doom many people hold. It suggests that even if one does not expect imminent catastrophe, there are conceivable scenarios where radical approaches would be justified. The core argument is that weird projects, despite being likely useless by default, offer a longer and fatter tail of upsides due to their higher variability. This means that reallocating some funding to them could be rational, not despite but because of the uncertainty. The piece calls for explicit, substantial effort to explore such strategies, pushing the Overton window in AI safety. It does not prescribe specific projects but rather argues for the need to consider them seriously.

FAQ

Why should we fund weird AI safety projects?
Because they have higher variability, which gives them a longer and fatter tail of upsides, even if most current AI safety work is useless.
Who should consider funding radical AI safety initiatives?
Even those without very short timelines or high p(doom) should agree that some timelines or probabilities justify funding radical strategies.

Get the latest AI Safety & Alignment news every morning

For example, today's edition would include:

  • AI advice followed by 79%, but well-being unchangedITmedia AI+ · 5h ago
  • Enterprises face agent governance gapSiliconANGLE AI · 8h ago
  • BOE governor warns of AI risks to financial systemSiliconANGLE AI · 8h ago

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleAnthropic staff praised Zlibrary in chats cited by Sony lawsuit