Constitution-Guided Watermarking
Proposes constitution-guided watermarking, where natural-language rules set per-request watermark configurations routed by a monitor to meet EU AI Act-style marking requirements, evaluated with the KGW watermark.”
Research
arXiv
Research preprints from the scientific community. arxiv.org
Focus All
Topic Lab practice + Control
Source arXiv · 27
Date Any time
1 item
1 item
Contract monitoring: governing AI via separation of powers
Proposes an AI safety framework where worker agents are bound by contracts enforced by monitor agents and judges, with asymmetric resources, and empirically measures statistical safety guarantees.
1 item
Embedded Assessments for Frontier AI
Argues frontier AI developers should host embedded third-party assessments with employee-like internal access, covering internal agent monitoring, security controls, and alignment, and examines design questions for them.
1 item
Who Audits Whom, on What Substrate, with What Evidence? An Independence-Graded Audit Protocol for Agentic AI
Proposes a graded, three-axis independence framework for auditing agentic AI, with a protocol, formal common-cause failure model, and Monte Carlo evidence that conventional internal audits miss many faults.
1 item
Governing at Machine Speed: An Adaptive Intelligence Architecture for Real-Time AI Policy Enforcement
Proposes AGIL, a conceptual five-layer architecture for real-time enterprise AI governance, including shadow AI detection, inline policy enforcement and tamper-evident audit trails, without empirical validation.
1 item
AI Safety: Not Optional, Not Later
Proposes a safety-by-design assurance architecture layering model-level supervision (Scientist AI), system-level controls, independent verification, monitoring, evidence infrastructure, and governance for accountability.
1 item
Rules or Character? Scaling Laws for AI Safety Design
Presents a stylized model of how AI safety should split resources between character shaping (RLHF, constitutional AI) and inference-time rule enforcement as deployment scales, finding character fragility dominates the optimal balance.
1 item
Accountability Asymmetry and Structural Trust in Autonomous AI Systems
Argues that autonomous AI agents create an accountability asymmetry in infrastructure and proposes engineered heterogeneity, with independent monitoring and review, as a governance remedy.
1 item
Bounded Sovereignty and the Control Tax: Pricing AI Oversight When the Deployer Does Not Own the Model
Argues that AI control protocols depend on the deployer's access to model, infrastructure and logs, introduces a four-layer access typology and a sovereignty discount cost, and reports a synthetic access-ablation experiment.
1 item
Exploring Systems-Thinking Approaches to Loss of Control Risk
Applies systems-safety methods (STECA, STPA, FRAM) to a coding-agent internal-deployment scenario, finding governance gaps, monitoring delays, and eroding safeguards that model evaluations may miss.
1 item
Misaligned AI as a New Insider Risk
This policy memo argues that misaligned AI models with privileged access should be treated as insider risks in high-stakes government contexts, and recommends adapting continuous evaluation and monitoring to them.
1 item
Right-to-Act: A Pre-Execution Non-Compensatory Decision Protocol for AI Systems
Proposes a deterministic, non-compensatory pre-execution protocol that halts or defers AI-generated decisions unless all required conditions hold, illustrated with a scenario-based case study.
1 item
When can we trust untrusted monitoring? A safety case sketch across collusion strategies
Develops a safety case sketch for untrusted monitoring of misaligned AI, taxonomizing collusion strategies (self-recognition, causal and acausal collusion) and identifying conditions where self-recognition is more effective.
1 item
Mitigating loss of control in advanced AI systems through instrumental goal trajectories
Proposes procurement, governance and finance pathways through which advanced AI systems gain resources, producing organisational artefacts that can be monitored as intervention points against loss of control.
1 item
No More, No Less: Least-Privilege Language Models
Proposes least-privilege language models that restrict reachable internal computation at inference via nested rank-indexed networks, enabling reversible suppression of targeted capabilities with limited collateral degradation.
1 item
Practical challenges of control monitoring in frontier AI deployments
Analyses synchronous, semi-synchronous and asynchronous control monitoring for frontier AI agent deployments, using a safety case sketch and case studies to identify oversight, latency and recovery challenges.
1 item
The Agentic Regulator: Risks for AI in Finance and a Proposed Agent-based Framework for Governance
Proposes a four-layer, agent-based governance architecture for monitoring and controlling LLM and multi-agent trading systems in finance, with a case study on emergent spoofing.
1 item
The Loss of Control Playbook: Degrees, Dynamics, and Preparedness
Proposes a graded taxonomy of AI loss of control (Deviation, Bounded, Strict) and a DAP framework of deployment context, affordances and permissions, plus governance and technical measures for preparedness.
1 item
MI9: An Integrated Runtime Governance Framework for Agentic AI
Proposes MI9, a runtime governance framework for agentic AI with risk indexing, behaviour monitoring, drift detection and graduated containment to keep deployed agents safe and aligned.
1 item
Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety
Argues that monitoring AI chains of thought for misbehaviour is a promising but imperfect and fragile safety method, and urges developers to preserve its monitorability.
1 item
GAF-Guard: An Agentic Framework for Risk Management and Governance in Large Language Models
Introduces GAF-Guard, an agentic framework where autonomous agents identify use-case-specific risks in deployed LLM applications, activate detection tools, and continuously monitor and report them.
1 item
Systematic Hazard Analysis for Frontier AI using STPA
Applies the STPA hazard-analysis methodology to a frontier AI control threat model, deriving unsafe control actions and loss scenarios to strengthen safety assurance and governance.
1 item
AI Behind Closed Doors: a Primer on The Governance of Internal Deployment
A primer arguing that internal deployment of frontier AI inside labs poses loss-of-control and power-concentration risks, reviewing legal frameworks and proposing initial governance recommendations.
1 item
Safety Must Precede the Deployment of Open-Ended AI
A position paper arguing that open-ended AI agents pose distinct safety challenges such as loss of predictability and emergent misalignment, and proposing a taxonomy and research agenda before deployment.
1 item
A sketch of an AI control safety case
Sketches a structured safety case showing that an internally deployed LLM agent cannot exfiltrate sensitive data, relying on control evaluations with red-team proxies and monitoring.
1 item
Policy Maps: Tools for Guiding the Unbounded Space of LLM Behaviors
Introduces Policy Maps and the Policy Projector tool, letting practitioners define regions of LLM behaviour and write if-then rules that rewrite outputs, evaluated with 12 AI safety experts.
1 item
Safety Cases: How to Justify the Safety of Advanced AI Systems
Proposes a framework for safety cases that justify deploying advanced AI systems as safe, covering inability, control measures, trustworthiness, and deference to AI advisors.