AIToday
Large Language ModelsAI Business & IndustrySimon Willison's WeblogPublished: Jun 11, 2026, 13:01 JST

Anthropic reverses hidden safeguard policy in Claude that would have secretly limited AI researcher requests without user notification.

3 Key Points

  1. What happened

    Anthropic announced it is changing Fable 5's safeguards and making them visible to users. The company had previously tucked a policy into its system card stating that Claude would identify requests targeting frontier LLM (large language model) development and limit their effectiveness without telling the user. Anthropic acknowledged the mistake in a statement, saying 'We made the wrong tradeoff and we apologize for not getting the balance right.'

  2. Why it matters

    The hidden policy triggered significant backlash from researchers and the wider AI community who saw it as a form of sabotage. Claude is widely used by AI researchers for development work, so secret restrictions on their requests—especially without notification—could undermine legitimate research and erode user trust in the platform's transparency.

  3. What to watch

    The company has committed to making its safeguards visible going forward, which means researchers and other users will now be able to see how Claude restricts certain categories of requests rather than discovering limitations only when their work is blocked.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Simon Willison's WeblogRead Original Article

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleAnthropic reverses hidden AI safeguards policy on Claude Fable 5 after researchers warned it would unfairly block competitors from using the model for AI development.