
What happened
Anthropic gave six METR staffers hardware, office space and internal tools, putting them roughly on par with its own risk teams. METR will publish findings independently, though customer data, attorney-client privileged information and model architecture details stay off-limits.
Why it matters
The arrangement goes further than Anthropic's other outside reviewer deals, letting an independent group publish what it finds. Anthropic can request redactions in predefined categories, but METR may publicly say whether it thinks those redactions were justified.
WHO IT HITSIndependent AI safety auditors gain a template for deeper, publish-first access to frontier labs, while Anthropic's own compliance and communications teams must manage the risk of findings appearing outside their control.
Summaries like this, in your inbox every morning.
The METR arrangement is unusual in how far Anthropic says it goes: six outside staffers work with company hardware, office space and internal tools, roughly on par with Anthropic's own risk teams. That is a deeper level of access than a typical outside review, where an auditor sees selected materials rather than sitting inside the operation.
The limits are drawn tightly. Customer data, attorney-client privileged information and model architecture details stay off-limits. Anthropic also reserves the right to request redactions in predefined categories — a provision that could otherwise hollow out an independent review, which is why the two sides agreed METR may publicly state whether it thinks those redactions were justified.
Anthropic frames the redactions as necessary rather than cosmetic: it argues that some safety-relevant information cannot be published because it could help attackers or because it is commercially sensitive. The open question the arrangement itself creates is whether an auditor with inside access can still speak freely enough to be useful — Anthropic's concession that METR may publicly judge the redactions looks like an attempt to answer that in advance.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
Cammarata reinterprets InceptionV1's cat-car neuron as a V-shape detector, not two unrelated concepts

A Zenn contributor sorted AI use into three modes — AI as an assistant, AI running alongside people, and AI th…

A developer released agent-guardrails, a one-script Python standard-library plugin that guards Bash, Write, Ed…

A Qiita article compared automated red-teaming methods for LLM apps — GCG, PAIR, and TAP — using mock implemen…

In a webinar hosted by French Mathematical Society president Isabelle Gallagher, Fields Medal winner Hugo Dumi…

Anthropic said on October 15 it has started giving METR's six staff company devices, office space and access t…
