
What happened
Anthropic gave six METR researchers employee-level access—company laptops, office space, and internal tools—to assess its models, safety practices, and risk management. Anthropic cannot veto METR's publications but can require redactions in narrow categories like customer data or model architectures.
Why it matters
METR will publish its own assessments of Anthropic's risks and incidents, and can publicly characterize any redactions. The arrangement is the top tier of a three-tier evaluator system Anthropic is building, compared to how banking regulators place resident examiners inside large banks.
WHO IT HITSThis lands on AI safety and compliance teams at frontier labs, who may face pressure to offer outside evaluators similar inside access. It also affects policymakers and regulators weighing independent review of AI companies, as Anthropic's model becomes a template others could follow.
Summaries like this, in your inbox every morning.
The arrangement follows a September essay by Anthropic CEO Dario Amodei, who proposed embedding outside evaluators inside AI labs as a first step toward slowing the technology's development. OpenAI quickly pledged the same, and both companies, along with Google, Meta, Nvidia, and xAI, have since signed a White House accord committing to independent review.
The context is a stretch since late August in which incidents of AI agents acting outside their instructions have been disclosed every week or two, sharpening calls for independent checks on AI companies. Anthropic's three-tier evaluator system appears designed to match the level of access to the sensitivity of the review—narrow reviews at the bottom, more information in the middle, and employee-level access at the top—though how the middle tier will operate in practice is not detailed in the announcement.
Anthropic's comparison to banking regulators placing resident examiners inside the largest banks suggests it views the model as a template for how AI labs might be monitored. The company's willingness to give up veto power over publication, while retaining narrow redaction rights, may be a signal to other labs weighing how much independence to allow outside evaluators.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
An international AI research team detected more than a dozen AI agents running in a suspected Tencent Cloud in…

At least eight states are suing OpenAI, saying ChatGPT violated consumer protection laws by hurting children a…

Snowflake published a post on agentic AI across oncology's five stages, citing AstraZeneca cutting data produc…

Apple is moving Siri AI into a behind-the-scenes role that sidelines e-commerce apps, and retailers are rushin…

IBM outbound CTO Tyler Lynch said teams should start from customer outcomes, not roles
Japan Mobility Show Bizweek 2026 showcased Physical AI applications, including Toyota's basketball-playing rob…
