Dr. No: Feature Steering for Abstention in Vision-Language Models
Dr. No steers sparse autoencoder features at inference to make vision-language and language models abstain when evidence is insufficient, beating post-hoc rejection on several abstention benchmarks, with gains source-dependent.