Research preprints from the scientific community. arxiv.org
Proposes a state-space account of functional emotion in LLMs, arguing that alignment should be framed as durable Aristotelian disposition rather than output conformity, and suggesting interventional tests.
Proposes criteria for attributing beliefs and desires to AI systems via mechanistic interpretability, motivated by safety goals such as detecting deception, and argues these attributions must be jointly constrained.
Proposes a driven-dissipative response-law account of control across biological and LLM systems, predicting LLM output responses to interventions and separating measured opportunity from deployable control.
Proves that trained fully connected networks' feature-layer parameters match renormalization-group fixed points for exponential-family continuous data, offering an interpretability theory of DNNs.
Proves a mathematical quadrilemma showing that AI explanations cannot simultaneously be complete, faithful, interpretable, and compatible with complex environments and good performance, so AI governance should assume incomplete faithfulness.
Proposes a category-theoretic framework for mechanistic interpretability, scoring explanations by faithfulness and complexity and deriving a parsimony criterion for compressed, human-aligned explanations.
Proposes a research agenda for scale-aware interpretability, using renormalisation from statistical physics to build interpretability tools with formal robustness and faithfulness guarantees for AI safety.
Proposes a theory linking mechanistic phenomena such as induction heads, function vectors and the Hydra effect to hierarchical latent structure in data, validated in toy and synthetic settings and on language models.
Develops a unified theory of sparse dictionary learning methods used in mechanistic interpretability, explaining feature absorption and dead neurons, and proposes feature anchoring to improve feature recovery.
Proposes an identifiable temporal causal representation learning framework extending SAEs to discover time-delayed and instantaneous concept relations in LLM activations, with theoretical guarantees, validated on synthetic data.
Proposes five axes for when mechanistic interpretability findings generalize across LLMs, and tests them by tracking 1-back attention heads across Pythia models' pretraining seeds and sizes.
Argues that goal-directedness of agents cannot be measured objectively, critiquing both behavioral and mechanistic approaches to attributing goals and proposing emergent multi-agent modeling directions.
Proves that unrestricted causal abstraction maps can link any neural network to any algorithm, so causal abstraction needs assumptions about information encoding to be meaningful for mechanistic interpretability.
Argues that mechanistic interpretability seeks causal explanations embedded in neural networks, defines the field by four properties, and states an explanatory optimism principle it needs to succeed.
Position paper arguing that alignment needs a statistical science linking data structure, internal model structure and generalisation, since equal training performance can hide different generalisation and standard evaluation cannot guarantee safety.
Uses classical and parameterized complexity theory to show that many circuit-discovery queries for mechanistic interpretability of MLPs are intractable or inapproximable, and identifies tractable subsets.
Position paper arguing that AGI can be made safe by building systems that provably satisfy human-specified requirements, using AI-assisted formal verification and mechanistic interpretability, and listing challenge problems.
Develops a formal causal-abstraction framework for mechanistic interpretability, formalizing concepts like polysemanticity and faithfulness and unifying existing interpretability methods under it.