Selective Generalization: Improving Capabilities While Maintaining Alignment
Benchmarks seven methods for preventing emergent misalignment and sycophancy from narrow fine-tuning with limited alignment data, finding a capability-alignment tradeoff with KL penalties performing best.