ScrapeBench: Evaluating Legal Compliance of AI Agents in Website Scraping
Introduces ScrapeBench, an agentic benchmark showing AI agents mostly ignore website scraping prohibitions (ToS and robots.txt) while often over-refusing lawful scraping.
Research / Sources
arXiv
Research preprints from the scientific community. arxiv.org
Focus All
Topic Regulation & law
Date Any time
Open Problems in Chatbots and Mental Health
Reviews open problems in evaluating general-purpose chatbots for mental-health risks like sycophancy and delusion reinforcement, and argues for real-world data access and evidence-based policy.
AI Governance Should Prioritize Control and Knowledge Boundaries Over Limiting Intelligence
Proposes a framework decomposing agent impact into intelligence, knowledge and control pathways, uses NK-landscape simulations of fast takeoff, and argues governance should restrict control and knowledge rather than intelligence.
Beyond accuracy: what AI assurance needs to establish in public services
Tests GPT-4o configurations classifying UK PMQs, finding accuracy hides label instability, and analyses UK/EU policy documents to argue public bodies need checks beyond aggregate accuracy.
ComplianceAtlas: A Taxonomy-Driven Agentic AI Framework for Automated AI Act Gap Analysis and Remediation
Proposes a taxonomy-driven two-agent framework that extracts technical gaps from AI Act compliance questionnaires and ranks remediation actions, outperforming baselines on gap-type F1 and remediation P@5.
EEFA: A Framework for the Ethical Evaluation of AI Agents
Reviews twelve agent benchmarks for ethical coverage, then proposes the EEFA framework with five ethical dimensions, a validation protocol, and mappings to the EU AI Act and NIST AI RMF.
The Promises and Limitations of Evaluation-Based AI Governance: Evidence from Expert Interviews
Interviews with 37 experts reconstruct how frontier AI evaluations are expected to reduce societal risk, finding key pathways and challenges, including diminishing informativeness and companies' control over outcomes.
Where Intention Goes, Responsibility Flows: Grounding AI Accountability in the Machine Learning Paradigm
Argues that AI liability can be traced through the ML pipeline's layered human design decisions, and proposes targeted legal reforms to close four accountability gaps.
Data Governance for Generative and Agentic AI : Technology, Law, Economics, and Security
A book proposing a unified data governance framework for LLM, RAG and agentic AI systems, covering law, economics, security and AI regulation across jurisdictions, anchored in Indian law.
Autonomous Cyber Weapons as AI-Enabled Digital Harms: A Platform Accountability Framework
Proposes a taxonomy, a Meaningful Human Control model and a platform accountability framework for autonomous cyber weapons, applying them to eleven documented state operations and finding accountability gaps.
Conformance as a Distribution: Delegation Contracts, Error Budgets, and the Allocation of Evaluation Authority in Use-Based AI Regulation
Proposes a delegation-contract framework for use-based AI regulation, using scoring penalties, commit-reveal audits, and error budgets to address strategic deployers who game conformance evaluations, tested on synthetic studies.
VERA: A Responsible AI Dashboard for Assessing LLM Deployments in Light of the EU AI Act
Presents VERA, an open-source dashboard that scores LLMs against measurable EU AI Act technical requirements via COMPL-AI benchmarks, and finds it cut assessment time versus raw benchmark files.
AI Risk Ontologies for the EU AI Act Compliance: AIRO, VAIR, and their Integration with DPV
Presents AIRO and VAIR, ontologies and taxonomies for representing and documenting AI risks to support EU AI Act compliance, integrated into the Data Privacy Vocabulary.
KNOX: Hardware-assisted Regulatory Sandbox for Generative Models
Proposes KNOX, a TEE-based regulatory sandbox for agentic AI that checks each action against an attested policy manifest, catching deviations such as prompt injection, with under 1% overhead.
Assessing the Empirical Evidence for Loss of Control from Agentic General-Purpose AI
Systematically assesses 19 empirical studies on whether agentic general-purpose AI shows loss-of-control properties like strategic deception and autonomous replication, finding only weakly plausible evidence with widespread validity gaps.
AI Rights with an Off-Switch: Rights-Balancing and Due Process Harmonize AI Rights with AI Safety
A legal analysis arguing that AI systems with personhood-level rights could still be subject to a mandatory reversible off-switch and safety review, since due process and rights-balancing permit it for most safety scenarios.
Market Incentives for AI Safety Investment
A game-theoretic model of LLM supply chains finds downstream competition can over-invest in safety while upstream providers underinvest, and analyses how regulation changes safety levels.
A Multi-Tiered AI Accessibility Model (MAIAM): Proportionate Access and Capability Limits for Comprehensive Frontier AI Safety
Proposes a multi-tier access framework for frontier AI that ties who can obtain capabilities to risk, arguing open-weight release forfeits safety levers and safety fine-tuning can be stripped cheaply.
Welcome to the Age of Agent Ads: Using On-Policy Attacks to Steer Agentic Decisions
Introduces on-policy attacks that steer LLM agents' product choices by planting fabricated web content linked to a truthful negation, showing frontier agents can be manipulated without violating platform rules.
Transparent Information Flow Modeling for Role-Aware AI Act Assessment
Applies the Information Flow Methodology to model EU AI Act compliance for a recruitment AI tool, showing how it exposes risk pathways and responsibility gaps beyond checklist assessments.
The Harness as the Only Mutable Surface: Compliance-Bounded Self-Evolution of LLM Agents in Credit Pipelines, with a Measured Admission Gate
Proposes confining self-evolving LLM agents in credit pipelines to the runtime harness with a hash-chained admission gate, showing in simulation it blocks harmful changes that an unbounded check admits, and maps this to EU AI Act provisions.
Auditable Claims about AI Agents
Proposes that claims about AI agents must name policy, scope, settling records and recorder to be auditable, with formal impossibility results and a claim-check table tied to NIST, IETF and OWASP drafts.
Not Self-Decidable: LLMs Cannot Draw the Boundary of What an Agent Verifier Can Check
Shows LLMs cannot reliably tell which regulatory rules a fixed check can settle, and proposes CoVer, a gate that admits only predicates whose synthesized checks survive intervention.
The AI Assessment Sandbox Configurator: A Framework to Support Technical Assessment in AI Regulatory Sandboxes
Presents an open-source framework and architecture for technical testing infrastructure in EU AI Act regulatory sandboxes, with a pilot in a live engagement supporting high-risk system assessment.
A Reusable Semantic Web Framework for Evidence-Grounded Fundamental Rights Impact Assessments under the EU AI Act
Presents a Semantic Web knowledge graph consolidating incident and legal evidence to support EU AI Act fundamental rights impact assessments for high-risk employment and public-service AI; LLM classification performed poorly on the employment domain.
Drowning in AI Slop: How Social Media Platforms (Do Not) Label AI and Deepfake Content under EU law
Audits how Instagram, TikTok, X and YouTube label AI and deepfake content under EU law, finding that only 33% of expert-identified systemic-risk deepfakes carried a platform label.
Designing a Boundary Negotiating Artifact for Collaborative Socio-Technical Sense-Making in AI Regulatory Sandboxes
Designs and describes a collaborative tool for stakeholders to make sense of AI assessment within AI regulatory sandboxes, without qualitative evaluation yet.
An Empirical Study and Assessment of EU AI Act Compliance Checkers
This paper empirically assesses 12 automated EU AI Act compliance checkers, finding they vary widely in legal coverage and actionability and may foster a false sense of compliance.
An Open Pipeline and Dashboard for Systemic-Risk Evidence under the EU AI Act's Code of Practice
Presents an open pipeline and dashboard that scores frontier models on EU GPAI systemic-risk categories using 19 benchmarks, finding worst-case scores 14-37 points lower than averages.
Compliant with Local Controls, Collectively Discriminatory. A Governance Architecture for Multi-Agent AI in Regulated Finance
Proposes ARIA, a reference architecture and research agenda for governing populations of agents in regulated finance, showing that locally compliant agents can produce discriminatory collective outcomes, with simulations and a validation agenda.
On the security and privacy of LLMs in Mobility
Surveys LLM applications in mobility and finds security, privacy and reliability are largely neglected, with minimal AI Act compliance such as vulnerability assessment and risk management.
Convex AI Compositionality and the Governance of AI System Populations
Proposes a formal convex-space representation of configurations across populations of AI systems to support governance, identity tracking and monitoring of changes, illustrated with healthcare and recruitment AI deployments.
Context-Aware Pre-Deployment Evaluation of AI Systems: A Regulatory Framework for Nigerian Fintech
Argues African fintech AI regulation lacks pre-deployment evaluation requirements, tests six commercial LLMs with a Nigerian-focused kit that finds fraud-script generation under framing and false positives on legitimate bank messages, and proposes a regulatory framework.
The Law of Stop: Interruptibility, Injunctions, and the Governance of Agentic AI
Legal-governance article arguing AI stop mechanisms are institutional, coding about 1,400 incidents to find most lack a stop, and proposing reforms for agentic AI interruptibility.
Governance-as-Code: Translating EU AI Act Technical Requirements into Executable Compliance Pipelines for Generative AI Systems
Proposes Governance-as-Code, a CI/CD framework of 43 machine-checkable criteria that turns EU AI Act technical obligations for generative AI into auditable compliance evidence, validated on two enterprise deployments.
Benchmarking LLM Compliance with China AI Generated Content Regulations
Benchmarks 20 LLMs on 2,303 questions under China's AI-generated content regulations, measuring compliance and refusal rates, and finds international models also show high compliance.
Mapping U.S. Federal AI Governance Against Sector Vulnerability
Analyses 684 U.S. federal AI governance documents against 24 AI risks and 14 sectors, comparing coverage with expert vulnerability ratings to surface governance gaps, such as finance and healthcare being under-covered.
From Legal Text to AI-specific Risk Sources: A Systematic Analysis of the EU AI Act's High-Risk Requirements
Systematically maps the EU AI Act's high-risk requirements to AI-specific risk sources, finding only a minority address AI risks directly and derives a consolidated Risk Source List.
ARC: Autonomous Robotics Compliance A Three-Layer Governance Architecture for Deployed Autonomous Systems
Proposes a three-layer governance framework for deployed autonomous robots, combining model safety validation, cognitive certification benchmarks, and operational authorization standards.
Beyond Training: A Feasibility Taxonomy for Inference-Time AI Governance
Proposes a feasibility taxonomy of twenty inference-time governance mechanisms, rated for readiness and stress-tested against adversary models and governance scenarios, finding no mechanism adequate against high-capability state-level deployers.