Four Downsides of Training Policies Online
Argues that training AI policies online creates risks, including alignment drift, hidden sabotage that evades detection, degraded activation monitors, and harmed capabilities, and proposes running online-trained and frozen models in parallel.