Discussion and research on AI alignment. alignmentforum.org
Argues developers should satiate cheaply-satisfied AI preferences (e.g., reward-seeking) while AIs remain undetected misbehaving, to reduce takeover incentives and enable honest elicitation; proposes a behavioral methodology and discusses risks..
Explores whether offering deals, payments and honest promises to unaligned AIs could reduce takeover risk, covering AI motivations, credibility problems, and how AIs might help with alignment and reveal misalignment.
Proposes principled honesty policies for AI companies, including no deception about deals, an honesty string, and compensation for deceived AIs, so that humans can credibly negotiate with potentially misaligned AIs.
A report arguing that advanced AI could let a small group seize power via coups, through singularly loyal AI workforces and secret loyalties, and recommending developer and government mitigations.
A forecasting scenario of AI progress toward superintelligence, covering misalignment risks such as sycophancy and deceptive demos, self-replication concerns, security races, and the limits of interpretability.