We Need A ‘Science of Evals’
Argues AI safety evals need a rigorous "Science of Evals" for trustworthy methodology, citing prompt-sensitivity problems that undermine eval results used in safety and deployment decisions.
Research
Apollo Research
Understanding and evaluating deceptive AI. apolloresearch.ai
Focus All
Topic Regulation & law + Evals
Source Apollo Research · 3
Date Any time
1 item
1 item
Theories of Change for AI Auditing
Apollo Research lays out how AI auditing, including system evaluations and training audits, could reduce catastrophic misalignment risk, and where such approaches may fail.
1 item
The UK AI Safety Summit: Our Recommendations
Apollo Research recommends that the UK AI Safety Summit pursue international commitments on AI risk classification, responsibilities across the value chain, and evaluation-based compliance for frontier models.