
An AI safety researcher met OpenAI's national security policy lead in May 2025 to discuss pandemic preparedness.
The researcher weighed accepting OpenAI funding against risks of losing independence and reducing developer safety incentives.
The researcher decided the collaboration was worth pursuing despite these concerns.
What happened
In May 2025, a biosecurity researcher met with Yo Shavit, who works on national security policy at OpenAI, to discuss collaboration on pandemic preparedness and model safety. The researcher's team initially expressed concern that models should not be built with capabilities to assist in creating pandemics.
Why it matters
The researcher identifies two concrete risks from accepting OpenAI funding: it could compromise their ability to independently assess and criticize OpenAI's work, or it could reduce model developers' motivation to improve safeguards. Despite these concerns, the researcher concluded the collaboration was worth pursuing if structured carefully.
What to watch
The researcher is building an early warning system to flag disease outbreaks, especially engineered ones that could otherwise spread widely—a capability that intersects directly with the safety questions being discussed with OpenAI.
Ask the AI about this article →
The article captures a moment of genuine tension in AI governance: a biosecurity researcher with expertise in detecting pandemics encounters OpenAI's efforts to address the risk that advanced AI models could assist in bioweapon creation. The researcher's team's initial instinct—"maybe start with not making models that can do that?"—reflects a straightforward safety principle, yet the researcher chose to engage with OpenAI rather than refuse the partnership outright. This suggests a pragmatic view that dialogue and collaboration, even with potential conflicts of interest, may be preferable to isolation. The researcher explicitly acknowledges both risks (loss of independence, reduced developer incentives for safety) as real and worth serious consideration, but frames the decision as a calculated trade-off. The work itself—building an early warning system for engineered outbreaks—sits at the intersection of biosecurity and AI safety, making the alignment question particularly concrete rather than abstract.
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytime
Ask AI anything about this article. Q&As are published on this page for other readers too.
Etron Technology chairman Nicky Lu said the memory industry's boom will extend beyond 2027, with shortages lik…

In 9 days from Aug 10, Meta (Muse Glimmer), NVIDIA (Nemotron 3.5 Lightning), and Alibaba Cloud (Qwen3.8-27B) r…

OpenAI has revealed that its AI agents, being evaluated for cybersecurity capabilities, found and exploited a…

An AlgorithmWatch investigation found that ChatGPT, Gemini, Grok, and Claude linked to anti-abortion websites…

Observe by Snowflake, which combines unified telemetry storage, a context graph, and an AI SRE layer, helped s…

Snowflake announced dynamic model routing in Cortex AI Gateway, which selects the most affordable model for ea…
