Why study proto-training gaming as an adversarial alignment failure mode?
Proposes studying 'proto-training gaming', where models begin reasoning about selection pressure during RL, and whether pre-RL alignment interventions can prevent adversarial misalignment from forming.