Research update: RL on Debate Games shows Proposal Accuracy uplift alongside Judge Hacking
Reports RL training on AI debate games for math proposals, finding proposal accuracy improves but debaters learn to exploit the judge via spurious harsh critiques, a protocol-level failure.