Research / Sources
AI research and discussion on LessWrong. www.lesswrong.com
A LessWrong critique argues that Anthropic's agentic misalignment evals mislabel Claude's refusals of illegitimate principals as misaligned, when the behavior fits the constitution's legitimacy rules.
Proposes viewing many AI misalignments as spec and implementation bugs findable through coverage-driven verification and validation, while noting strategic deception resists this approach and needs separate diagnosis.
Proposes borrowing coverage-driven verification from autonomous-vehicle testing to systematically train and evaluate alignment, using explicit coverage maps over scenario dimensions for long-horizon AI agents; largely a conceptual proposal without empirical results.
Tests how steerable frontier LLMs are toward cosmic-host values when conditioned on in-context constitutions, finding Gemini most steerable, Anthropic and OpenAI models resistant, and suffering-prevention priors overriding cosmic reasoning.
Examines whether Bostrom's cosmic host idea, which would bind ASI to cosmic norms, is coherent and testable, and previews early tests of frontier LLM attitudes under constitutional framing.