Policy research on advanced AI security and governance. www.iaps.ai
Report defines highly autonomous cyber-capable agents (HACCAs), forecasts their arrival, outlines five operational tactics for sustaining attacks, and analyzes strategic and tail risks of frontier AI offensive cyber capabilities.
IAPS's response to a US federal RFI recommends AI R&D priorities on model security, reliability and capability assessments, supply chain security, and monitoring adversary AI, citing misalignment risks.
A survey of 53 experts ranking 105 AI reliability and security research areas by importance and tractability, finding dangerous-capability evals and multi-agent risks most promising.
A consensus paper from many researchers outlining risks from advanced AI, including loss of human control, and proposing urgent priorities for AI R&D and governance.