Testing Gemini models for scheming tendencies
Google DeepMind introduces Gram, an automated auditing framework, and honeypot evaluations to test whether Gemini coding agents would sabotage their safeguards.
Safety research from Google DeepMind. deepmindsafetyresearch.medium.com
Google DeepMind introduces Gram, an automated auditing framework, and honeypot evaluations to test whether Gemini coding agents would sabotage their safeguards.
Proposes a framework for evaluating general-purpose models for dangerous capabilities such as manipulation, deception and cyber-offense, and for alignment, to flag extreme risks early.