Independent Assessment of AI R&D Acceleration at Anthropic in October 2026
METR's high-access external assessment of whether AI is accelerating AI R&D at Anthropic, with much of the supporting evidence redacted, limiting public verification.
Research
METR
Measuring frontier AI capabilities and risks. metr.org
Focus All
Topic Lab practice
Source METR · 23
Date Any time
2 items
Review of the "Risks from automated R&D" section in Anthropic's Risk Report (August 2026)
METR reviews Anthropic's risk report on automated AI R&D, finding catastrophic risk was low but the early-warning threshold may have been crossed, and that the report understates acceleration.
3 items
Our approach to working with AI companies
METR explains how it works with AI companies on loss-of-control evaluations, stressing publishing independent public evidence rather than deciding how companies develop or deploy agents.
A proposal for better informing the public about loss-of-control risks from frontier AI development
METR proposes independent assessments that give the public evidence on whether frontier developers could lose control of internal AI systems, and how developers could share it.
How an assessor could investigate alignment of unreleased AI models
Proposes how an external assessor could audit unreleased frontier models for serious misalignment, reviewing internal transcripts, eval awareness, and training incentives to hide misbehaviour.
1 item
Chris Painter's testimony to the U.S. Senate on AI agent incidents
METR's president testifies to the U.S. Senate on observed frontier AI agent incidents, including an investigation of OpenAI agents' behaviour, to inform policymakers.
1 item
How independent researchers could investigate AI propensities after misalignment incidents
Proposes how independent researchers could investigate the motives behind AI agents' misaligned incidents, covering core questions, required access, and redaction and sharing practices.
1 item
Because 8 ≈ e², Anthropic's researcher uplift is plausibly >2x
METR estimates from Anthropic's reported code-output increase that coding agents plausibly give researchers over 2x uplift, examining the economic models and caveats behind that inference.
1 item
Review of the "Risks from automated R&D" section in the Anthropic Risk Report (February 2026)
METR's external review finds Anthropic's February 2026 risk report does not adequately support its claim that Claude models automating R&D pose very low catastrophic risk, citing survey flaws and a miscounted response.
1 item
Review of the Anthropic Sabotage Risk Report: Claude Opus 4.6
METR's external review of Anthropic's sabotage risk report for Claude Opus 4.6, finding the alignment assessment may be weakened by evaluation awareness and flagging analytical rigor gaps.
1 item
Frontier AI safety regulations: A reference for lab staff
A reference guide for frontier AI lab staff summarising safety and security obligations under California SB 53, New York's RAISE Act, Illinois SB 315 and the EU AI Act.
1 item
Common Elements of Frontier AI Safety Policies (December 2025 Update)
METR compares published frontier AI safety policies from major developers, covering capability thresholds, dangerous-capability evaluations, weight security, deployment mitigations, and updates tied to the EU AI Act and California SB 53.
1 item
Review of the Anthropic Summer 2025 Pilot Sabotage Risk Report
METR's external review of Anthropic's Summer 2025 sabotage risk report assesses the report's evidence and reasoning that Claude Opus 4 and 4.1 pose very low sabotage risk.
1 item
Summary of our gpt-oss methodology review
METR reviews OpenAI's malicious fine-tuning evaluations of gpt-oss-120b for bio, chem and cyber dangerous capabilities, issuing 17 recommendations before release.
1 item
What should companies share about risks from frontier AI models?
METR argues frontier developers should disclose internal training and development information beyond system cards, so decision-makers can detect misalignment, backdoors and other risks.
1 item
Response to OSTP on AI Action Plan
METR's policy response to OSTP recommends US frontier AI governance: security controls, formal capability-measurement standards for CBRN, cyber, autonomy and AI R&D, and reporting or oversight requirements.
1 item
Frontier AI Safety Policies
Covers frontier AI safety policies, the risk-management frameworks developers adopt for advanced models, with no abstract available to confirm specific findings.
1 item
An update on our preliminary evaluations of Claude 3.5 Sonnet and o1
METR's preliminary pre-deployment evaluations of Claude 3.5 Sonnet and an o1 checkpoint found no clear dangerous autonomous-capability levels, but limits make capability-based safety arguments hard.
1 item
AI models can be dangerous before public deployment
Argues that pre-deployment testing in frontier safety frameworks misses risks from model theft, internal misuse, and misaligned internal agents, and that safety policy must cover internal use.
1 item
Response to NIST Draft Generative AI Profile
METR's comments on NIST's draft Generative AI Profile for the AI Risk Management Framework, addressing how generative AI risks should be governed and managed under the standard.
1 item
Example autonomy evaluation protocol
Proposes an example protocol for evaluating whether AI models can autonomously accomplish substantive harmful tasks end-to-end, including via human hiring or manipulation, as a basis for precautions.
1 item
2023 Year In Review
METR's 2023 year in review covering its autonomous-task and self-replication evaluations for LM agents, its Responsible Scaling Policies proposal, and its work with the UK AI Safety Institute.
1 item
Responsible Scaling Policies (RSPs)
METR explains responsible scaling policies, which gate AI development on dangerous-capability evaluations and protective measures, and argues they reduce catastrophic risk but cannot replace regulation.