Predicting When RL Training Breaks Chain-of-Thought Monitorability
Introduces a conceptual framework predicting when RL training pressure makes chain-of-thought unmonitorable, with empirical tests on a coin-flip task and obfuscated reward hacking.}
Safety research from Google DeepMind. deepmindsafetyresearch.medium.com
Introduces a conceptual framework predicting when RL training pressure makes chain-of-thought unmonitorable, with empirical tests on a coin-flip task and obfuscated reward hacking.}
Google DeepMind outlines its technical approach to preventing severe harms from AGI, covering misuse and misalignment risks in foundation models and prioritising mitigations for foreseeable capabilities.