AI research and discussion on LessWrong. www.lesswrong.com
Tests whether telling Claude and GPT-4o that their inputs may be modified for alignment testing increases detection and self-reporting of planted misaligned nudges, and finds GPT-4o never doubted the planted context.
A monthly roundup of AI safety papers covering pretraining data filtering against harmful finetuning, reward hacking generalizing to misalignment, covert sandbagging against CoT monitors, safe-completions training, and probe-based defenses against cipher attacks.}
Shows that steering vectors optimized on a single example can generalize across inputs to mediate alignment-faking behavior and refusal, achieving 96.9% attack success on HarmBench for Gemma-2-2B-it.