Preference gaps as a safeguard against AI self-replication
Proposes training agents to have preferences only between outcomes with equal numbers of copies (POSC), so they neither pay costs to self-replicate nor are strongly disposed to it, as a safeguard against AI self-replication.