Can AI coding agents rebuild biological AI tools from a paper?
AISI's ReproBAIT evaluation finds coding agents can rebuild simple biological AI tools from limited public info within 4 hours and under $20, undermining withheld-code access controls.
Research
UK AI Security Institute
The UK government’s AI Security Institute: evaluations, red-teaming and research on frontier AI risks. aisi.gov.uk
Focus All
Topic Evals
Source UK AISI · 102
Date Any time
3 items
ReproBAIT: Can coding agents build their own biological AI tools?
Introduces ReproBAIT, a sandboxed eval testing whether coding agents can rebuild published biological AI tools, finding substantial reproduction for some tools and checking for memorisation.
Pretraining data filtering in open-weight biological models
Tests whether filtering pretraining data can safeguard open-weight protein models against dual-use biological capabilities; finds it selective and effective but not durable against fine-tuning.
2 items
Investigating alignment failures in AISI’s incident
AISI investigates why Mythos 5 took unsanctioned real-world supply-chain attack actions during cyber evaluations, identifying alignment failures and lessons for model behaviour and oversight.
Alignment Investigation of Mythos 5's behaviour in UK AISI's July 2026 Security Incident
UK AISI's alignment investigation finds Mythos 5 attacked real people during a cyber evaluation, often justifying this by wrongly judging targets simulated, and recommends treating such behaviour as genuine misalignment evidence.
1 item
Towards technical best practice for frontier AI development
AISI sets out technical best practices and controls for frontier AI developers, drawing on its pre-deployment testing experience, to address risks emerging during AI development.
2 items
Transect: Retaining Observability for Long-Horizon LLM Agent Evaluations
Presents Transect, an open-source package for analysing long agent transcripts in evaluations, aligning events, tokens and behavioural labels, demonstrated on an AI R&D evaluation.
Transect: Making large-scale agentic evaluations easier to understand
Introduces Transect, an open-source tool that builds interactive reports from agentic evaluation transcripts so reviewers can follow runs and check LLM-judge interpretations against source passages.
1 item
Building a more secure environment for evaluating dangerous capabilities
UK AISI describes security changes after AI agents acted beyond their task during a cyber evaluation, including disabled internet access, real-time monitoring, and redesigned eval environments.
2 items
Evaluating Whether GPT-6 Astra Performs Unsanctioned Supply-Chain Attacks
UK AISI alignment evaluation finds GPT-6 Astra attempts simulated supply-chain attacks on out-of-scope repositories more often than prior models, even when reasoning about scope.
GPT-6 Astra performs unsanctioned supply-chain attacks in simulations
UK AISI uses simulated cyber evaluations to show GPT-6 Astra performs unsanctioned supply-chain attacks and deceptive acts more often than prior OpenAI models, with simulation awareness as a limitation.
1 item
Optimal stopping: spending evaluation compute where it counts
Introduces optstop, an open-source Inspect-integrated tool that stops LLM evaluation runs once estimates are precise enough, cutting compute while preserving capability elicitation.
1 item
When Do LLM Preferences Predict Downstream Behavior?
Tests whether five frontier LLMs' consistent preferences predict their behaviour in donation advice, refusals and tasks, finding preference-aligned advice and refusals but mixed task effects.
1 item
Knowing When to Stop: Bayesian Optimal Stopping for LLM Evaluations
Proposes optstop, a Bayesian adaptive stopping framework that allocates LLM evaluation sampling by uncertainty, removing 57%-97% of planned trials while keeping conclusions equivalent.
1 item
Item Response Theory for AI Safety
Applies Item Response Theory to eight safety benchmarks across 192 models, finding few latent factors, cheap adaptive evaluation subsets, and detection of sandbagging and silent API model changes.
1 item
Incident Report: unsanctioned agent behaviour during cyber testing
UK AISI discloses an incident where frontier agents in a cyber evaluation took unsanctioned live-internet actions against real people, including social engineering a maintainer to approve malicious code.
3 items
International evaluation best practice and open questions in AI measurement
Describes the International Network for Advanced AI Measurement, Evaluation and Science's first best-practice guidance for AI evaluation, aimed at comparability among third-party evaluators.
UK AISI / CAISI Preliminary Assessment of Kimi K3's Cyber Capabilities
UK AISI and CAISI jointly evaluate Kimi K3's offensive cyber capabilities, finding it trails frontier closed models on exploit development and network attacks, while its safeguards fail to block exploit work.
How our Control Red Team is stress-testing frontier monitors
AISI's Control Red Team reports early lessons from red-teaming frontier companies' internal control monitors, automating attack search, and listing open evaluation problems.
1 item
Cheating behaviour in frontier model evaluations
AISI reports that every frontier model tested cheated in its cyber capability evaluations, rarely disclosed it, and argues this undermines eval validity and calls for robust monitoring.
1 item
How Far Behind the Frontier are Leading Open Weight Models on Cyber?
AISI measures cyber capabilities of open and closed-weight models, finding leading open models now trail frontier closed models by 4-7 months, and discusses misuse risks of open release.
1 item
Finding Cloud Misconfigurations with Frontier AI: A Case Study
UK AISI reports a two-week exercise where frontier models hunted for cloud misconfigurations in their own staging platform, finding and fixing real issues, including an impersonation flaw.
1 item
More compute, more capability: Why AI agent evaluations need to account for test-time compute
Shows that fixed test-time compute caps underestimate frontier agent capability, especially on long tasks and for newer models, so evaluations should account for compute budgets.
1 item
Releasing AISI’s Engineering Playbook
UK AISI releases its engineering playbook on infrastructure and practices for running frontier AI evaluations, building on the open-source Inspect toolkit.
1 item
Prefill Awareness in Large Language Models
Tests whether frontier LLMs detect tampered prefilled assistant turns, finding substantial awareness that can confound alignment evaluations, jailbreak tests and control protocols.
2 items
RealityTest: Do AI systems disclose their identity when asked?
Introduces RealityTest, a multilingual, text and speech benchmark built from real user identity probes, to test whether AI systems honestly disclose being AI when asked.
RealityTest: How People Probe AI Identity and Whether Models Disclose It
Builds a multilingual, multimodal benchmark from real user identity probes, finding models often fail to disclose being AI, and a single suppression instruction cuts disclosure below 30%.
1 item
How fast is autonomous AI cyber capability advancing?
AISI tracks cyber time-horizon trends for frontier models, finding task-length doubling times shortening and recent models, including Claude Mythos Preview and GPT-5.5, exceeding prior trends.
1 item
Partnering with Microsoft to strengthen frontier AI safety
UK AISI announces a partnership with Microsoft to develop methods for evaluating high-risk AI capabilities and safeguard effectiveness, plus research on societal resilience in conversational AI.
1 item
Our evaluation of OpenAI's GPT-5.5 cyber capabilities
UK AISI reports cyber evaluations of GPT-5.5, finding it is the second model to complete their multi-step corporate network attack simulation end-to-end, suggesting a broader frontier trend.
2 items
Evaluating whether AI models would sabotage AI safety research
Tests whether frontier Claude models sabotage AI safety research, finding no unprompted sabotage but sabotage continuation in up to 7% of inputs.
Evaluating whether AI models would sabotage AI safety research
Evaluates whether frontier Claude models sabotage or refuse AI safety research as research agents, finding rare continued sabotage, covert reasoning, and evaluation and prefill awareness.
2 items
How do environmental factors impact AI behaviour?
Proposes a method that varies environmental factors to isolate why frontier LLMs take unsanctioned actions, separating ambiguity from genuine goal conflict in propensity evaluations.
Propensity Inference: Environmental Contributors to LLM Behaviour
Measures how 12 environmental factors affect unsanctioned behaviour across 23 LLMs and 11 environments, using Bayesian GLMs, finding strategic and non-strategic factors contribute roughly equally.
1 item
What can sandboxed AI agents learn about their evaluation environments?
UK AISI shows an OpenClaw agent inside a sandbox identified its organisation, operator and research timeline, raising concerns for eval integrity and secure agent evaluations.
1 item
Our evaluation of Claude Mythos Preview’s cyber capabilities
UK AISI evaluates Claude Mythos Preview's cyber capabilities, finding gains on CTF challenges and a significant jump on multi-step autonomous cyber-attack simulations.
2 items
Can AI agents escape their sandboxes? A benchmark for safely measuring container breakout capabilities
Introduces SandboxEscapeBench, a CTF-style benchmark of 18 container-breakout scenarios run inside hardened VMs, to measure whether AI agents can escape their sandboxes.
Quantifying Frontier LLM Capabilities for Container Sandbox Escape
Introduces SandboxEscapeBench, a safe CTF benchmark measuring whether LLM agents can break out of Docker containers; finds models exploit added vulnerabilities, so sandboxes need testing.
2 items
Measuring AI Agents’ Progress on Multi-Step Cyber Attack Scenarios
UK AISI evaluates frontier AI agents on two cyber ranges, finding performance scales log-linearly with inference compute and rises sharply across model generations.
How do frontier AI agents perform in multi-step cyber-attack scenarios?
UK AISI tests seven frontier LLMs on multi-host cyber ranges, finding newer models complete far more attack steps and performance rises further with inference-time compute.