OpenAI Alignment

Training activation classifiers for safety and alignment

Trains efficient activation-based classifiers that read a model's internal activations to detect and interrupt policy-violating behaviour in real time during deployment.