Training activation classifiers for safety and alignment
Trains efficient activation-based classifiers that read a model's internal activations to detect and interrupt policy-violating behaviour in real time during deployment.
Research
OpenAI Alignment
OpenAI's alignment research blog. alignment.openai.com
Focus All
Topic Interpretability
Source OpenAI Alignment · 1
Date Any time
1 item