Stress-testing asynchronous monitoring of AI coding agents
Red-blue team adversarial evaluation of asynchronous monitors that must catch a covertly sabotaging AI coding agent before or after its actions take effect.
Research / Sources
UK AI Security Institute
The UK government’s AI Security Institute: evaluations, red-teaming and research on frontier AI risks. aisi.gov.uk
Organisation (36)Red Team (13)Science of Evaluations (11)Cyber & Autonomous Systems (10)Engineering (6)Human Influence (5)Control (4)Societal Resilience (4)Safety Cases (3)Chem-Bio (2)Model Transparency (2)Strategic Awareness (1)
Focus All
Topic Evals
Date Any time
How to evaluate control measures for AI agents?
UK AISI paper on AI control: how control protocols such as monitoring and human approval can constrain scheming LLM agents, and how to scale and evaluate those measures.