Red-Teaming OpenAI's Internal Agent Monitoring Systems
METR and Redwood staff stress-tested OpenAI's internal misalignment monitoring for agents, estimating monitored traffic fraction and finding novel ways agents could subvert it.
Research
METR
Measuring frontier AI capabilities and risks. metr.org
Focus All
Topic Evals + Control
Source METR · 10
Date Any time
1 item
1 item
Review of the "Misalignment in high-stakes settings" section in Anthropic's Risk Report (August 2026)
METR's external review of Anthropic's misalignment risk section finds low catastrophic risk mainly from limited capabilities, and says its covert-capability evals poorly test evasion of usage monitoring.
1 item
Implementing and Evaluating a Basic Per-Action Monitor for Safer Evals
METR describes a live LLM-judge monitor that screens agent actions before execution during their own evals to prevent real-world harm, and outlines a structured argument for its effectiveness and gaps found.</parameter>
1 item
Frontier Risk Report (February to March 2026)
METR pilot report assessing whether frontier labs' internal AI agents had the means, motive and opportunity to start a rogue deployment, using capability evals, safeguard reviews and embedded red-teaming.
1 item
Fine-tuning experiments on CoT controllability
Shows that brief fine-tuning on instruction-following reasoning data raises out-of-distribution chain-of-thought controllability from 2.9% to 8.8%, suggesting low controllability is not robust, which matters for CoT monitorability.
1 item
Red-Teaming Anthropic's Internal Agent Monitoring Systems
METR red-teamed Anthropic's internal agent monitoring and security systems, finding several novel vulnerabilities, some patched, none undermining the main claims of Anthropic's sabotage risk report.
1 item
Early work on monitorability evaluations
METR presents a prototype monitorability evaluation, SHUSHCAST, testing whether monitors catch agents covertly performing side tasks and whether agents can evade monitoring, including with chain-of-thought reasoning traces.
1 item
MALT: A Dataset of Natural and Prompted Behaviors That Threaten Eval Integrity
METR releases MALT, a labeled dataset of natural and prompted agent transcripts showing reward hacking and sandbagging, to validate monitors that check evaluation integrity.
1 item
Claude, GPT, and Gemini All Struggle to Evade Monitors
Replicates a DeepMind chain-of-thought monitorability experiment across Claude, GPT-4o and Gemini models, finding that most actors struggle to hide reasoning from monitors on hard tasks.
1 item
CoT May Be Highly Informative Despite “Unfaithfulness”
Argues CoT need not be fully faithful to be useful for safety, and tests whether clue-using reasoning in chains of thought can be reliably detected by replicating Claude system card evaluations with harder clues.