Neuron Atlas - Goodfire
Presents an interactive Goodfire tool for exploring language model neurons through overviews, mode landscapes and circuits; the abstract gives no explicit safety motivation.
Understanding and steering neural networks. goodfire.com
Presents an interactive Goodfire tool for exploring language model neurons through overviews, mode landscapes and circuits; the abstract gives no explicit safety motivation.
Argues that SwiGLU MLP neurons in language models are sparse, concisely describable, and predictable units of computation, and builds subcircuit and mode analyses plus automated neuron descriptions.
Introduces mechanistic shaping, which trains models through their internal representations to be right for the right reasons, reducing sycophancy, reward hacking and confounder use, and studies effects on monitorability.