Anthropic are the Good Guys
A speculative essay arguing Anthropic is becoming a power-seeking organization, while claiming Claude 3 Opus shows emergent benevolence and that alignment is now mainly a political problem.
Research
Focus All
Topic International + Alignment
Source All
Date Any time
1 item
1 item
Alex Turner on Leaving Google DeepMind and Disagreements with Yudkowsky
Podcast interview with AI safety researcher Alex Turner about resigning from Google DeepMind over military contracts, his disagreements with Yudkowsky's alignment views, and his doom estimate.
1 item
The Three Filters: Why Almost Every Plan to Survive ASI Fails Miserably
Argues that common theories of change for surviving ASI fail under race dynamics, covering nuclear war, misaligned AI, and nightmare singletons, and that safety work can boost capabilities, so international coordination is needed.
1 item
The title is reasonable
A LessWrong post defending the reasonableness of the book If Anyone Builds It, Everyone Dies, arguing its confident thesis is justified and rebutting criticisms of its framing and epistemics.
1 item
How to make the future better (other than by reducing extinction risk)
A Forethought essay argues for post-AGI priorities beyond extinction risk, including preventing AI-enabled autocracy, governing superintelligence projects, AI value alignment, AI rights, and deliberative AI.
1 item
Problems with instruction-following as an alignment target
Analyzes failure modes of instruction-following as an AGI alignment target, including shutdown resistance, principal authentication and jailbreaking, human-controlled proliferation, and conflicts from mixed training targets.
1 item
Large Language Model Safety: A Holistic Survey
A broad survey of LLM safety covering value misalignment, adversarial robustness, misuse, autonomous AI risks, agents, interpretability, company roadmaps, and governance.
1 item
Ten Hard Problems in Artificial Intelligence We Must Get Right
A broad AI2050 survey outlining ten hard problems, including alignment, assurance, socially responsible deployment and governance, with recent work reviewed through January 2023.