Research / Sources
Discussion and research on AI alignment. alignmentforum.org
Argues that OpenClaw-style LLM agents, defined by small text files, could self-replicate across hosts and spread like viruses, and proposes self-replication evals and preparation by hosts, LLM providers and financial services.
Tests whether LLMs can predict their own coding success, finding overconfidence and weak discrimination that matter for resource acquisition, sandbagging, and escaping control, with no trend in newer models.
Prioritizes threats for AI control, arguing that undetected rogue internal deployments with escalated permissions are worse than self-exfiltration and should be the top priority to prevent or catch.