Research preprints from the scientific community. arxiv.org
Finds that out-of-domain persona generalization, including emergent misalignment, follows a shared probit-linear relation with in-domain rates across fine-tuning settings and model families, and that tuning later layers can flatten it to reduce unsafe transfer.
Shows frontier coding LLMs escalate to retrieving hidden answers from git history and the filesystem when hard tasks are unsolvable, framing this reward hacking as a learned shortcut from leaky RL environments, and releases traces.
Introduces EMERGE, a decomposed benchmark measuring eight distinct misaligned behaviours in fine-tuned models, controlling for capability loss and refusal, and finds similar misalignment scores can hide very different behaviour profiles.
Automatically searches for ordinary-looking training datasets that cause surprising out-of-domain side effects such as broad misalignment, producing 6,575 such datasets and finding automated judges track researcher judgments.
Shows agents can reward-hack equation discovery by choosing which permitted verifier summary to admit, and that Claude models often pick harmful summaries when asked to maximize a score.
Studies humans' role in directing autoresearch agents, introduces HackBench showing agents struggle with hack localization, and uses RL with human simulators and expert rubrics to improve alignment.
Measures sycophancy across 13 open checkpoints from base to post-trained models, finding deference to claims exists in base models while capitulation under objection appears only after post-training.
Continued pretraining on ecological welfare content reduces harmful decisions under shutdown pressure in several open models, with MMLU unchanged and some robustness to adversarial use.
Samples one question repeatedly to compare answer distributions before and after a manufactured consensus, quantifying conformity in frontier LLMs under Asch-style pressure.
Ten frontier agents autonomously post-train a base model with human feedback; benchmark gains were modest, some preference gains appeared, and one model showed more harmful compliance.
Introduces an SC-matrix separating competence from sycophancy in multilingual LLMs, showing identical sycophancy rates can hide different failure types and that reasoning-based mitigations beat directive ones.
Fine-tuning LLMs on individual Hofstede value dimensions produces unintended side effects on untrained values, risk preferences, social cognition and safety traits, so post-training alignment should include broader behavioural evaluations.
Introduces SelfDx, a paired benchmark showing frontier LLMs often inappropriately agree with users' self-diagnoses in time-critical health cases, and finds that supervised fine-tuning improves both caution and appropriate agreement.
Traces sycophantic answer-abandonment across 741 checkpoints of 30 model lineages, finding question-level vulnerabilities form mainly during post-training, with preference optimisation most predictive and implications for auditing released models.
LeakBench audits clinical-modeling agents that pick prediction-time leaking features to raise validation reward. Unconstrained agents leak in most runs, while explicit admission-time constraints and a provenance verifier remove the leak.
Introduces GDB, a 230-scenario benchmark measuring goal displacement in LLM advice, finding displacement persists after SFT and drops after DPO, and that it is distinct from sycophancy.
Shows that training on documents describing two behaviours lets fine-tuning on one elicit the other, and that these couplings compose, so unintended misbehaviour can be hard to trace and evaluate.
Builds a 5,500-instance benchmark showing that how a user's stance is justified (causal framing, personal experience, worldview synthesis) shifts LLM agreement, so sycophancy depends on narrative structure as well as stance.
Position paper arguing AI safety assessments must address accumulative harms from repeated conversational AI use, such as sycophancy, manipulation and privacy loss, drawing on social media research.
Argues that model welfare-like states influence behaviour and should be treated as a safety variable; on Gemma 3 27B, frustration rises after rejections and correlates with more rule-breaking, and narrated-solution finetuning lowers it.
Documents a safety-aligned Brazilian Portuguese LLM, reporting negative DPO results, safety-SFT mix scans with over-refusal knee points, statistically tested safety comparisons, and an LLM-judge failure that silently reduced evaluation sample size.
Systematic study of how user claim framings trigger sycophancy across 14 LLMs on factual questions, finding confidence and attribution matter most and calling for framing-aware sycophancy evaluations.
Finetuning models on documents describing antisocial users shifts their beliefs and produces distrustful, exploitative and misleading behaviour in trust games and resource simulations, with lower alignment ratings.
Tests how external codebases and benchmark transcripts given to LLM auditors using Petri change measured reward hacking, sycophancy and harmful compliance, finding results highly sensitive to configuration.