Misalignment and Strategic Underperformance: An Analysis of Sandbagging and Exploration Hacking
Analyses how misaligned models could sandbag by underperforming on purpose, and how exploration hacking could defeat RL training, then discusses countermeasures and their limits.