Discovering Undesired Rare Behaviors via Model Diff Amplification
Proposes model diff amplification, comparing logits before and after post-training, to surface rare undesired behaviors such as emergent misalignment and backdoors for red-teaming and monitoring.