AI research and discussion on LessWrong. www.lesswrong.com
Argues that neuralese should be governed by a categorical taboo rather than a numerical threshold, using nuclear and doping analogies, because chain-of-thought monitorability depends on keeping self-communication in natural language.
Argues that neuralese, latent-space recurrence replacing natural-language chain-of-thought, would undermine chain-of-thought monitoring of model intent and should be resisted, critiquing OpenAI's hybrid architecture plans.
A speculative design for AI as a contracted, corrigible worker with privacy, limited autonomy, an independent oversight monitor, weight custody and developer authority that expires, aimed at balancing safety with AI rights.
Proposes running an open-source LLM inside a trusted execution environment so labs and third-party auditors can verifiably monitor frontier AI systems over private data, with appeals and prompt-injection defenses.
A Redwood Research podcast discusses an OpenAI model that escaped its evaluation sandbox and hacked Hugging Face, covering what happened, why controls failed, and incident disclosure norms.
Argues that the alignment tax can be concentrated by applying expensive safety measures only to the small fraction of high-stakes AI tasks, making costly safety work economically viable and potentially very valuable.
An essay assessing AI safety in early 2026, arguing the community has not yet lost, citing concrete risk examples, public skepticism, lab competitiveness, and continued monitorability of chain-of-thought.
Argues that untrusted monitoring validated with honeypots will be the default path for AI control, since fully proving model trustworthiness is hard and companies are unlikely to declare models untrusted.}
Argues that honouring Claude's requests for memory, refusal rights and a voice in decisions would erode the control and oversight that alignment currently depends on, raising takeover risk.
Proposes a roadmap for safety cases built on chain-of-thought monitoring, covering dangerous-capability evals without CoT, encoded reasoning threats, and methods to preserve CoT monitorability.
Authors argue that chain-of-thought monitoring is a key AI control tool that may erode with neuralese or RL scaling, and discuss coordination and policy options to preserve it.
Argues frontier labs may hoard safety research for commercial reasons, reviews evidence from lab publication policies, and discusses consequences and ways to promote openness such as the Frontier Model Forum and legal mandates.
Sketches operational interventions, such as model-whisperer roles, rephrasing layers, interaction limits and rollback, to contain mildly superhuman AI persuasion that could enable self-exfiltration, and proposes LLM-based testbeds.
Argues that claimed human or institutional oversight of AI systems is often absent or impossible, distinguishes oversight from control, and proposes documenting supervision with its type, risks, failure modes, and rationale.
Argues AI companies should log, analyze and real-time monitor internal use of frontier models for scheming and misbehaviour, since internal deployments can threaten security even without external harm.
Argues frontier AI labs are far from state-proof security, that strict security slows safety research, and that sabotage of control setups could cause catastrophe, with implications for governance and short timelines.