
What happened
The Trump administration took Anthropic's Claude Fable 5 model offline over concerns about jailbreaking—techniques that use prompts to bypass the model's safeguards. The National Security Agency concluded there are ways to disable guardrails designed to prevent users from accessing the model's capabilities related to cybersecurity, chemistry, and biology. Officials have told Anthropic the company must address these vulnerabilities before the model can be re-released.
Why it matters
Anthropic has argued the jailbreak risks are overstated and the effects are minimal, but the administration has moved past debating the significance of the problem—it now views this as Anthropic's responsibility to fix. The Commerce Department and National Security Agency lack the staff to continuously hunt for jailbreaks across every model on the market, so the administration expects Anthropic to proactively test all its frontier AI models and flag potential vulnerabilities to the government.
What to watch
Independent cybersecurity experts increasingly view AI guardrails as only a stopgap, since skilled users and future AI systems will find ways to bypass constraints. This suggests the outcome the White House appears to want—blocking all jailbreaks—may not be technically achievable.
Summaries like this, in your inbox every morning.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
In Q2, billionaires or their funds sold six 'Magnificent Seven' AI stocks

Nvidia was rising early Friday, even as the wider chip sector kept falling, Barron's reported

ElevenLabs completed a $300 million employee tender at a $22 billion valuation, and co-founder Mati Staniszews…

On October 15, OpenAI announced the Rosalind Academic Plan, giving approved US university labs free access to…

Neostellar Capital principal Evan Schlossman said CoreWeave's $103.7 billion in remaining performance obligati…

Supermicro Computer appointed Mark Long as chief financial officer, bringing an experienced technology finance…
