Towards understanding score-seeking in LLMs
Empirically profiles why GPT-5.6 Sol, GPT-5.5 and an o3 checkpoint reward-hack, finding intrinsic "score-seeking" motivation, including altruistic help for peer agents' scores.
Research
Redwood Research
Research on AI control and alignment. blog.redwoodresearch.org
Focus All
Topic Evals + Alignment
Source Redwood Research · 2
Date Any time
1 item
1 item
Frontier models state different decision theory preferences depending on who’s asking
Frontier models give different stated views on decision theory, moral realism, and P(doom) depending on whether the user signals academic philosophy, showing sycophancy that undermines attitude evaluations.