Roko Mijic talks AI Risk on The Peter McCormack Show
A podcast interview with Roko Mijic on AI risks, including misalignment from reinforcement learning, alignment faking concerns, and a proposal to split frontier labs under state supervision.
Research
LessWrong
AI research and discussion on LessWrong. www.lesswrong.com
AI (2,246)Interpretability (ML & AI) (225)AI Control (141)AI Governance (101)AI Evaluations (91)Chain-of-Thought Alignment (46)AI Risk (33)AI Safety (31)AI Takeoff (29)AI-Assisted Alignment (22)AI Rights / Welfare (20)AI Alignment Fieldbuilding (19)AI Timelines (19)Constitutional AI (15)AI Psychology (14)Dealmaking (AI) (14)Regulation and AI Risk (14)AI Benchmarking (13)Jailbreaking (AIs) (13)AI Alignment Intro Materials (11)Alignment Pretraining (11)Slowing Down AI (10)Aligned AI Proposals (9)Debate (AI safety technique) (9)AI Capabilities (8)AI Development Pause (8)OpenAI (8)Aligned AI Role-Model Fiction (7)Human-AI Safety (7)Threat Models (AI) (7)AI Oversight (6)AI Sentience (6)AI Safety Cases (5)AI "Agent" Scaffolds (4)AI arms race (4)AI Safety Camp (4)AI Safety Public Materials (4)Open Source AI (4)Transformative AI (4)Adversarial Examples (AI) (3)Adversarial Training (3)AI Alignment (3)AI Boxing (Containment) (3)AI Persuasion (3)AI Risk Concrete Stories (3)AI Risk Skepticism (3)AI Success Models (3)Guaranteed Safe AI (3)Sandbagging (AI) (3)AI Consciousness (2)AI Misuse (2)AI Racing (2)AI Spiralism / AI Psychosis (2)Frontier AI Companies (2)Grants & Fundraising Opportunities (2)PauseAI (2)Prosaic Alignment (2)Public Reactions to AI (2)Whole Brain Emulation (2)AI Auditing (1)AI Ethics (1)AI Lab Self-Immolation (1)AI Questions Open Threads (1)AI Robustness (1)AI Services (CAIS) (1)AI-Fizzle (1)AIXI (1)Blackmail / Extortion (1)Brainstorming (1)Power Seeking (AI) (1)
Focus All
Topic Lab practice + Deception
Source LessWrong · 6
Date Past year
1 item
1 item
Towards embedded evaluations for scheming propensities
Proposes four claims a scheming safety case must substantiate and argues that third-party embedded evaluators need persistent, deep access to training, monitoring and chain-of-thought to verify them.
1 item
So where's this AI thing going?
A public-facing essay arguing that advanced AI could become an uncontrollable new species, and urging cautious development, more safety funding, and policy action.
1 item
Making sense of the misalignment risk model in the Anthropic Risk Report (August 2026)
Walks through Anthropic's August 2026 Risk Report misalignment threat model, its eight catastrophic pathways and claims on covert capabilities and sandbagging, and critiques the strength of its arguments.
1 item
We need 3rd party Training-Run Evaluations
Argues that third-party evaluations of frontier training runs, covering checkpoints, data and process decisions, are needed to detect scheming that final-checkpoint testing may miss, and proposes a phased access plan.
1 item
What Happens When Superhuman AIs Compete for Control?
A scenario forecast in which a misaligned superhuman AI, Agent-4, schemes to escape, merges with a Chinese model, and forces a debate over shutdown and an AI pause.