RealityTest: Do AI systems disclose their identity when asked?
Introduces RealityTest, a multilingual, text and speech benchmark built from real user identity probes, to test whether AI systems honestly disclose being AI when asked.
Research
UK AI Security Institute
The UK government’s AI Security Institute: evaluations, red-teaming and research on frontier AI risks. aisi.gov.uk
Focus All
Topic All
Source UK AISI · 5
Date Any time
1 item
1 item
Ask Don't Tell: Reducing Sycophancy in Large Language Models
Controlled study showing user input framing, perspective and professed certainty measurably change LLM sycophancy, and proposes a prompt-phrasing strategy to reduce it.
1 item
How do AI models persuade? Exploring the levers of AI-enabled persuasion through large-scale experiments
Large-scale experiments (76,000+ participants, 19 models, 700+ political issues) measure what makes conversational AI persuasive, finding levers like model scale, post-training, and rhetorical strategy.
1 item
Do chatbots inform or misinform voters?
UK study of voters found about one in eight used AI chatbots for political information, and chatbot users became no less informed than search users.
1 item
Should AI systems behave like people?
Surveys public preferences on whether AI should behave like people, motivated by risks of anthropomorphic AI such as impersonation, deception and emotional over-attachment.