AIToday
AI Safety & AlignmentAI Regulation & PolicyTHE DECODERPublished: Jul 28, 2026, 22:00 JST

Anthropic CEO: open-weight models risky, but not calling for ban

Anthropic CEO: open-weight models risky, but not calling for ban

3 Key Points

  1. What happened

    Anthropic CEO Dario Amodei published a blog post reaffirming that open-weight AI models pose significant risks—particularly to military superiority and biological threats—while clarifying that Anthropic has never advocated for an outright ban on them.

  2. Why it matters

    Amodei's position reflects a tension in AI governance: he argues open models lack safeguards and cannot be recalled once released, making them riskier than closed models for misuse in cyber or biological attacks. However, he acknowledges models without dangerous capabilities are a public good. His stance carries weight because his prior warnings about his own models' capabilities helped prompt a US ban, suggesting consistency in his risk assessment.

  3. What to watch

    Amodei is calling for stricter US chip export controls to prevent China from training more powerful models, mandatory safety tests for all powerful models regardless of licensing, and action against industrial distillation—a technique he says China uses to sidestep chip restrictions. Critics counter that such measures may fuel China's own chip industry growth and that distillation is a legitimate technique.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

Amodei's clarification arrives amid broader debate over how the US should regulate open-weight models. His position is nuanced: he accepts that some open models create public benefit while maintaining that capable ones pose distinct risks compared to closed alternatives. His reasoning centers on the irreversibility of released models—once distributed, they cannot be recalled—and the absence of safeguards that closed-model operators can enforce. The imbalance he emphasizes is particularly stark for biological threats, where defensive measures lag far behind offensive capabilities in timeline.

The credibility of Amodei's arguments is anchored in his track record: he has previously warned about the capabilities of his own models, warnings that contributed to a US ban, indicating consistency in his risk framing rather than opportunistic positioning. However, critics interpret his stance differently, suggesting that Anthropic's public caution about open weights may also serve its business interests by discouraging cheaper open-source competition. The letter signed by major tech companies opposing US restrictions on Chinese open-weight models, alongside reports that OpenAI continues lobbying against open weights despite signing that same letter, suggests the industry's stated positions do not always align with its lobbying efforts.

FAQ
Has Anthropic called for a ban on open-weight models?
No. Amodei stresses in his blog post that Anthropic has never advocated for a ban, and he acknowledges that models without dangerous capabilities are a public good.
What specific risks does Amodei identify with open-weight models?
He cites two main scenarios: authoritarian states like China could use them to gain military superiority or surveillance capabilities, and powerful open models could be misused for cyber or biological attacks. He argues the risk is particularly acute for biological threats, where sufficiently capable models could weaponize viruses quickly while building defenses would take years.
What policy measures is Amodei proposing instead of a ban?
He is calling for stricter US chip export controls so China cannot train more powerful models without US chips, action against industrial distillation (which China reportedly uses to sidestep chip restrictions), and mandatory safety tests for all powerful models regardless of licensing or origin.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleBNY ignores tokenmaxxing, measures AI by business outcomes instead