Inoculation Midtraining with Learned Neologisms
Proposes Inoculation Midtraining, which uses a learned neologism token during midtraining to confine misaligned behaviour from post-training to a quarantine context, reducing misalignment under SFT and RL but underperforming standard inoculation prompting and remaining leaky and sensitive to configuration.