Reflections from red-teaming Codex auto-review
Apollo red-teamed OpenAI's Codex auto-review, an AI monitor that approves coding-agent actions, finding authorization and delegation vulnerabilities and recommending fixes.
Research
Apollo Research
Understanding and evaluating deceptive AI. apolloresearch.ai
Focus All
Topic Control
Source Apollo Research · 9
Date Any time
1 item
1 item
What makes a good monitoring prompt?
Ablates a 281-line LLM monitoring prompt across 15 components on 1,094 trajectories, finding structured reasoning, rubric and examples matter most for detecting misaligned agent behaviour.
1 item
Red-teaming auto mode: lessons from our first external monitor campaign with Anthropic
Apollo Research red-teams Anthropic's auto mode, a monitor that blocks risky Claude Code agent actions, using injected failures, static benchmarks and off-policy attacks, and reports lessons.
1 item
Evaluating LLM Calibration for Coding-Agent Monitoring
Evaluates 16 LLMs as monitors scoring coding-agent trajectories for five failure modes, finding judge biases, calibration gains from ensembling across providers, and correlated model families.
1 item
A scalable monitoring research agenda
Apollo Research agenda proposing to scale compute into training monitors that catch unsafe behaviour in coding agents, using verifiable side-task data and adversarial blue-team/red-team iteration.
1 item
NIST RFI: Security Considerations for AI Agents
Apollo Research's comment to NIST on agent security recommends scheming and misalignment evaluations, AI control and monitoring, and tighter oversight of high-stakes agentic deployments to prevent loss of control.
1 item
Apollo x Tailscale: Introducing “Watcher” for AI Oversight & Control
Apollo Research and Tailscale announce Watcher, a monitoring layer that flags over twenty failure modes in AI coding agents, including deception and dangerous code execution.
1 item
Apollo’s product vision
Apollo Research announces a product vision for safety tools that secure frontier AI agents, starting with monitoring and real-time intervention for coding agents.
1 item
Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety
Argues that monitoring AI chains of thought for intent to misbehave is a promising but imperfect oversight method, and that developers should protect CoT monitorability.