Research / Sources
AI research and discussion on LessWrong. www.lesswrong.com
Argues that most misaligned AIs are partially misaligned, so negotiated deals could beat adversarial responses, and sketches the trust, verification and negotiation infrastructure needed to make such trades workable and safe.</reasoning_effort>
Proposes credible deal-making mechanisms (chain of trust, TEEs, blockchain escrow) to trade with a scheming AI in exchange for revealing misalignment, aiming to reduce takeover risk.
Taxonomy of barriers (gains from trade, counterparty risk on both sides) that could block deals with early misaligned AIs, with suggested interventions to make such deals feasible.
Proposes an IRB-like ethics framework for AI experiments to protect possible AI moral patients and build trust for future deals with misaligned AIs, discussing consent, deception and monitoring; tentative, high-level.