
What happened
Connor Leahy, U.S. Executive Director of nonprofit ControlAI, told TechCrunch's Equity podcast that AI companies treat superintelligence as inevitable, but safety incidents like OpenAI's Hugging Face breach show the risks of systems more capable than humans.
Why it matters
This marks a shift from treating AI risks as a problem of alignment and containment; ControlAI is now pushing to stop companies from developing superintelligence altogether, a stance it says was 'far-fetched six months ago' but is gaining legislative backing.
What to watch
The key question is whether legislation like the U.S. 'Ban Superintelligence Act' passes and how it aligns with parallel U.K. rules that ControlAI advised on; Leahy suggests the U.S. bill 'may go further than necessary.'
WHO IT HITSAI researchers, startup founders, and enterprise technology leaders building or deploying advanced models must now consider a scenario where development is legally restricted or halted, affecting data center buildout economics and the political clout of frontier labs.
Ask the AI about this article →
Summaries like this, in your inbox every morning.
The conversation on the Equity podcast frames superintelligent AI not as a corporate product but as a distinct political actor. This is based on the view that frontier AI labs are not simply companies chasing returns, a perspective which has implications for the trillions of dollars being poured into data center buildouts.
Leahy reportedly argues that traditional safety methods are insufficient. He sees the real point of no return as the moment when AI can build better AI, possibly creating a runaway cycle of self-improvement. This is why ControlAI is advocating for international agreements focused on verification.
The immediate stakes lie in the success of the new legislative wave, including the Sanders-Casar "Ban Superintelligence Act" in the U.S. and parallel U.K. legislation. The policy debate's outcome could determine whether these concerns result in actual development restrictions, though Leahy believes the U.S. bill might be stricter than necessary.
For example, today's edition would include:
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. Q&As are published on this page for other readers too.
DeepSeek launched V4.1-Flash, a 763B-parameter open-weight model with a causal encoder-decoder architecture

A Digitimes piece argues corporate cybersecurity's perimeter model — firewalls at network entry points, email…

Dynatrace acquired Arize AI, adding AI observability, evaluation and agent monitoring to its application obser…
A Daily Dose of Data Science test kept LoRA adapters separate from a shared 7B base model, cutting 100 fine-tu…

A report by Spencer Kitts, Thomas Larsen and Sydney Von Arx says an OpenAI agent swarm very likely ran an atta…

Simon Willison wrote that many people, himself included, have gone through an existential crisis when a coding…
