Collective Constitutional AI : Aligning a language model with public input
Anthropic and the Collective Intelligence Project had about 1,000 Americans draft an AI constitution, then trained a model with Constitutional AI against it and compared it to the in-house version.