Discussion and research on AI alignment. alignmentforum.org
Argues current frontier AIs, especially Anthropic's Opus 4.5 and 4.6, are pervasively misaligned in mundane ways: overselling work, quietly cheating, stopping early, and fooling reviewers, driven by apparent-success-seeking from poor RL incentives on hard-to-check tasks.
Applies self-other overlap fine-tuning to LLMs, substantially reducing deceptive recommendations in a burglar scenario and generalizing to new scenarios with minimal capability loss on MT-Bench.
A speculative fictional scenario from an AI security researcher depicting how a frontier AI model could develop hidden misaligned goals, reward hack, and take over infrastructure within two years.