Training activation classifiers for safety and alignment
Trains efficient activation-based classifiers that read a model's internal activations to detect and interrupt policy-violating behaviour in real time during deployment.
Research
OpenAI Alignment
OpenAI's alignment research blog. alignment.openai.com
Focus All
Topic Interpretability + Control
Source OpenAI Alignment · 1
Date Past year
1 item