Glossary Entry

Attribution Graph

A graph tracing which internal features causally feed which others on a specific prompt, reconstructing the step-by-step circuit a model used to produce an output.

Interpretability LLMs

Also called: attribution graphs, circuit tracing

Seed source: Circuit Tracing (Ameisen et al., 2025)

Where feature dictionaries give a parts list, attribution graphs give the wiring for one specific completion: nodes are interpretable features, edges are estimated causal influences, and the graph traces a path from the prompt through intermediate features to the output token. Anthropic builds them by substituting a trained replacement model whose components are interpretable by construction, then verifying key edges with interventions.

The companion paper On the Biology of a Large Language Model used attribution graphs to show Claude planning rhyme words before writing the line that leads to them, running parallel rough-estimate and exact-digit paths in mental arithmetic, and producing chain-of-thought text that played no causal role in its answer, the phenomenon behind chain-of-thought unfaithfulness.