Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis)alignment
Pretraining 6.9B LLMs on synthetic positive AI discourse yields more aligned models that persist through post-training and benign fine-tuning, while negative AI discourse increases misalignment.