Discussion and research on AI alignment. alignmentforum.org
Fine-tuned and prompted LLMs gain reasoning uplift only from very simple ciphers, suggesting encoded chain-of-thought is hard for current models and bearing on CoT monitorability and cipher-based jailbreaks.
Benchmarks commercial jailbreak-detection supervisors (BELLS), finding them weak and that simply prompting frontier LLMs to classify harmfulness works better, though those models often still answer harmful queries they flag.
Shows layered defenses for LLMs against CBRN misuse can be broken by a staged attack (STACK) reaching 71% success, while conventional attacks got 0%, and proposes hardening recommendations.