When is it important that open-weight models aren't released? My thoughts on the benefits and dangers of open-weight models in response to developments in CBRN capabilities.
Argues open-weight models at the level of significantly aiding amateur bioweapon creation would cause large expected fatalities, but that their benefits for mitigating loss-of-control risk make advocacy against them unwise; recommends mitigations and honest CBRN evaluations.