AIToday

AI Safety Seeding Initiative launches to build university groups

LessWrong AI6h ago
AI Safety Seeding Initiative launches to build university groups

Key takeaway

A new initiative called the AI Safety Seeding Initiative has launched to identify and support student founders building AI safety groups at universities that lack them. University groups are recognized as the most reliable source of AI safety talent, with a 2023 survey finding they were the single most common career influence for people working on catastrophic risks, yet dozens of strong schools remain without a group.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  • What happened

    The AI Safety Seeding Initiative, launched in partnership with Kairos, aims to identify and support student founders at top universities that currently lack AI safety groups. The initiative will help prepare these founders to apply to Pathfinder and launch groups this fall.

  • Why it matters

    University groups are the single most common career influence for people working on catastrophic risks, according to a 2023 survey. Dozens of strong universities could sustain such groups but do not have one, representing a gap in the pipeline for AI safety talent.

  • What to watch

    The initiative is calling for referrals of potential student founders at universities without existing AI safety groups (a list of eligible schools is available on the initiative's website, aisafetyseeding.org).

In Depth

The AI Safety Seeding Initiative, announced in partnership with Kairos, seeks to expand the number of AI safety university groups by identifying and supporting student founders at schools that currently lack them. The initiative's core insight is grounded in empirical evidence: a 2023 survey of people working on catastrophic risks found that university group involvement was the single most common career influence in the field, demonstrating the outsized importance of these grassroots communities in producing AI safety talent.

Despite their proven value, the initiative notes that dozens of top universities without existing AI safety groups could sustain them—a gap in the talent pipeline the program aims to address. The initiative will identify latent founders at these schools, support them through the group's earliest stages, and prepare them to apply to Pathfinder (suggesting a competitive fellowships or grants program) with a goal of launching this fall. The program is also calling on the community to help by referring potential student founders at universities without AI safety groups; a list of eligible schools is available on the initiative's website at aisafetyseeding.org.

Existing groups supported by Kairos, such as MAIA, AISST, and BASIS, have grown from small beginnings to become established communities within their universities, providing a model for what the initiative hopes to replicate. By formalizing the process of identifying and supporting new founders, the AI Safety Seeding Initiative aims to accelerate the creation of groups at institutions where the groundwork has not yet been laid.

Context & Analysis

University-based AI safety groups have emerged as a critical talent pipeline for the field. According to a 2023 survey cited in the announcement, group involvement was the single most common career influence among people working on catastrophic risks—a finding that underscores the outsized impact these grassroots communities have in shaping career trajectories. Yet despite their proven value, dozens of universities with the resources and academic strength to sustain such groups remain without one, representing a significant untapped opportunity for field building.

The AI Safety Seeding Initiative addresses this gap by targeting the earliest bottleneck: identifying and supporting potential founders before they launch. By partnering with Kairos, an established field-building organization that already supports existing groups like MAIA, AISST, and BASIS, the initiative can leverage existing expertise and networks to accelerate the creation of new groups. The focus on preparing founders for a Pathfinder application and a coordinated fall launch suggests a structured approach designed to increase the likelihood of sustainable group formation.

FAQ

What is the AI Safety Seeding Initiative?
It is a program launched in partnership with Kairos to identify latent founders at universities without AI safety groups, support them in the group's earliest stages, and prepare them to apply to Pathfinder and launch groups this fall.
Why are university AI safety groups important?
A 2023 survey of people working on catastrophic risks found university group involvement was the single most common career influence, and dedicated field-building organizations like Kairos exist largely to support these groups.

Get the latest AI Safety & Alignment news every morning

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytime

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →