Research preprints from the scientific community. arxiv.org
Presents a stylized model of how AI safety should split resources between character shaping (RLHF, constitutional AI) and inference-time rule enforcement as deployment scales, finding character fragility dominates the optimal balance.
Position paper proposing Positive Alignment, an agenda for AI systems that actively support human and ecological flourishing while staying safe, with technical directions across the LLM lifecycle and polycentric governance principles.
Presents HKGAI-V1, a Hong Kong-specific LLM built on DeepSeek and fine-tuned and RAG-augmented for local value alignment, plus an adversarial Hong Kong value benchmark for testing alignment with local ethical and legal standards.
Argues that misaligned AGI and aligned-AGI misuse pose catastrophic risks in tension, that many current alignment techniques may increase misuse risk, and that governance is essential.
Argues governments and public-interest institutions should fund alignment work reducing accident and misuse risk, identifies four ways alignment efforts could backfire, and proposes mitigations.