When Activation Oracles learn not to read: Concept-Specific Blind Spots in Fine-Tuned Oracles
Shows that Activation Oracles fine-tuned on a model hiding a secret word become worse at recovering that word, even though the information remains decodable, so fine-tuned oracles are unreliable for auditing concealed behaviour.