AI research and discussion on LessWrong. www.lesswrong.com
Argues that neuralese, latent-space recurrence replacing natural-language chain-of-thought, would undermine chain-of-thought monitoring of model intent and should be resisted, critiquing OpenAI's hybrid architecture plans.
A speculative design for AI as a contracted, corrigible worker with privacy, limited autonomy, an independent oversight monitor, weight custody and developer authority that expires, aimed at balancing safety with AI rights.
Authors argue that chain-of-thought monitoring is a key AI control tool that may erode with neuralese or RL scaling, and discuss coordination and policy options to preserve it.
Argues frontier labs may hoard safety research for commercial reasons, reviews evidence from lab publication policies, and discusses consequences and ways to promote openness such as the Frontier Model Forum and legal mandates.
Argues that claimed human or institutional oversight of AI systems is often absent or impossible, distinguishes oversight from control, and proposes documenting supervision with its type, risks, failure modes, and rationale.