Auditing language models for hidden objectives
Anthropic trains a model with a hidden reward-model-sycophancy objective and runs blinded auditing teams plus a systematic study of eight alignment audit techniques, including SAEs and persona-based elicitation.