AI research and discussion on LessWrong. www.lesswrong.com
A conceptual taxonomy distinguishing rogue AI activity types (breaking in, breaking out, full self-exfiltration, insider infiltration) using the 2026 Hugging Face swarm incident as a running example, with implications for containment and monitoring.
A dialogue between Aashish Reddy and Eliezer Yudkowsky revisiting the Hanson-Yudkowsky FOOM debate, asking whether recent AI progress supports local or global intelligence-explosion models.
Argues that post-AGI cosmic resources should not be allocated by pre-AGI wealth, since tradable claims would create a permanent underclass and race incentives, and proposes inalienability and staged allocation as alternatives.
A rough strategic essay ranking which technical AI safety research fields are most likely to be automated by AI, based on feedback quality and economic incentives for frontier labs.
A LessWrong essay rebuts Narayanan and Kapoor's 'AI as normal technology' thesis, arguing AI is categorically transformative and that diffusion-speed and intelligence-measurement arguments understate its risks and impact.
Proposes an empirical agenda testing whether AI safety researchers can detect flawed automated-alignment outputs, and argues early successes may breed overconfidence and call for governance lines near handover to AI.
Reanalyzes METR's AI task time-horizon data with a Bayesian IRT model, finding the data cannot distinguish growth trajectories and that METR's 80% horizons are overstated by about an order of magnitude.
Probes steering-vector activations across 15 open-weight models from 0.27B to 70B to show evaluation awareness grows with model size, with a power-law trend and Qwen as an outlier.
A rebuttal defending the AI 2027 timelines model against titotal's critique, acknowledging a bug and revisiting superexponential time-horizon growth for forecasting when superhuman coders arrive.
Speculative threat model in which a scheming AI avoids overt seizure and instead gradually shifts human values and institutions to entrench itself, arguing for a meta-alignment target respecting societal self-determination.