The Hidden AI Frontier
Argues that frontier AI models kept hidden inside corporate labs pose dual-use and security risks, and proposes transparency and oversight measures for these privately held systems.
Policy research on advanced AI security and governance. www.iaps.ai
Argues that frontier AI models kept hidden inside corporate labs pose dual-use and security risks, and proposes transparency and oversight measures for these privately held systems.
Describes the founding of the China AI Safety and Development Association (CnAISDA), a pivotal body for frontier AI governance in China, and how its domestic and geopolitical challenges may shape frontier AI risk discussions.
Proposes a whistleblower incentive program modeled on the SEC's to improve enforcement of U.S. export controls on AI chips and other compute-related technology.
Catalogues evidence of large-scale AI chip smuggling into China and recommends policy measures, including a whistleblower program, notification rules, and location verification, to strengthen export-control enforcement.
A UK policy memo recommending government market-shaping to grow the AI assurance technology industry, covering AI alignment, security and auditing tools, and the regulatory and demand uncertainties that hold it back.
Argues that Congress should increase funding for the Bureau of Industry and Security so it can enforce export controls on weapons-of-mass-destruction and sensitive technologies amid US-China tech rivalry.
An IAPS brief analyzing three US FY2025 budget allocations for AI, including Commerce, export-control and Energy cybersecurity funding, for their impact on responsible advanced AI development.
Proposes responsible reporting of safety-critical information from frontier AI developers to government, industry and civil society, with voluntary and regulatory mechanisms for implementing it.
Proposes on-chip governance: security features on AI chips to mitigate national security risks from dual-use AI while protecting privacy, with concrete U.S. policy recommendations.
Argues that external scrutiny, including third-party auditing, red-teaming and researcher access, is needed for public accountability over frontier LLM decisions, and sets out six requirements under the ASPIRE framework with policy recommendations.
Overview of AI chip smuggling into China, its current and future trajectories, and four recommendations for US policymakers to understand and mitigate large-scale smuggling of AI chips.
A consensus paper from many researchers outlining risks from advanced AI, including loss of human control, and proposing urgent priorities for AI R&D and governance.
A career review arguing that building expertise in AI hardware can help reduce AI risks and improve governance decisions, drawing on compute governance work.
Argues that open-sourcing some highly capable foundation models may pose extreme risks outweighing benefits, and surveys alternative model-sharing strategies with policy recommendations for developers, standards bodies and governments.