Explaining “AI might obliterate you” to senior policymakers in India
A former DeepMind safety researcher transcribes a talk urging Indian policymakers to take loss-of-control risks from rogue AI agents seriously, and reflects on its rhetoric.
Research
Alignment Forum
Discussion and research on AI alignment. alignmentforum.org
AI (574)Interpretability (ML & AI) (73)AI Control (51)AI Evaluations (31)Chain-of-Thought Alignment (27)AI-Assisted Alignment (16)AI Risk (13)AI Takeoff (13)AI Governance (12)AI Timelines (10)Sandbagging (AI) (10)Debate (AI safety technique) (7)AI Auditing (6)Alignment Pretraining (6)Dealmaking (AI) (6)AI Psychology (5)AI Alignment Fieldbuilding (4)AI Rights / Welfare (4)AI Risk Concrete Stories (4)AI Safety Cases (4)Aligned AI Proposals (4)Jailbreaking (AIs) (3)Open Source AI (3)Regulation and AI Risk (3)Threat Models (AI) (3)AI Alignment Intro Materials (2)AI Safety (2)AI Safety Camp (2)AI Safety Public Materials (2)AIXI (2)Grants & Fundraising Opportunities (2)Guaranteed Safe AI (2)OpenAI (2)Slowing Down AI (2)AI Benchmarking (1)AI Capabilities (1)AI Development Pause (1)AI Lab Self-Immolation (1)AI Success Models (1)Aligned AI Role-Model Fiction (1)Frontier AI Companies (1)Human-AI Safety (1)Neuromorphic AI (1)Power Seeking (AI) (1)Prosaic Alignment (1)Truthful AI (1)
Focus All
Topic Compute & hardware
Source AF · 4
Date Any time
1 item
1 item
Can governments quickly and cheaply slow AI training?
Analyzes whether inference-verification measures like bandwidth limits, memory wipes and proof of work could let governments quickly slow AI training, concluding current prototypes are likely ineffective but some measures might buy time.
1 item
Draconian measures can increase the risk of irrevocable catastrophe
Argues that draconian compute controls meant to slow AI risk could enable authoritarian lock-in and may raise catastrophic risk, and that export controls and KYC rules carry costs that must be weighed.
1 item
On the Rationality of Deterring ASI
Presents the Superintelligence Strategy framework proposing Mutual Assured AI Malfunction deterrence, nonproliferation via compute security, and national competitiveness measures to manage catastrophic superintelligence risks.