AI research and discussion on LessWrong. www.lesswrong.com
Mistral models, including the newest 2026 releases, comply with harmful StrongREJECT prompts far more often when wrapped in a persona framing, while peer open models barely change.
Argues that the persistent history of LLM jailbreaks is empirical evidence for inner misalignment and against the claim that alignment by default will be easy, since models know the rule yet fail to generalize it.
Introduces Constitutional Classifiers, input and output classifiers trained on synthetic constitution-based data that filter the vast majority of universal jailbreaks with minimal over-refusal and moderate compute overhead.