Probing Layers › Summary

Layer probing provides a fine-grained view of how linguistic information is organized across the depth of a transformer model. By training simple classifiers at each layer, you can map out which layers are responsible for which properties and observe the continuous evolution of representations from surface-level to semantically rich.

The key findings from a decade of probing research are consistent across model families:

• Lower layers encode surface and morphological features, along with basic syntactic categories.
• Middle layers encode deeper syntactic structure, including phrase and dependency relations.
• Upper layers encode semantic content, including entity types, semantic roles, and coreference.

This stratified organization mirrors the classical NLP pipeline and suggests that pre-training on natural language induces a natural hierarchy of abstraction. The hierarchy is not incidental: it reflects the computational dependencies among linguistic properties. Syntax provides the scaffolding that makes semantic interpretation possible, and the model learns to build this scaffolding before applying it.

Beyond the basic accuracy-by-layer profile, the field has developed more sophisticated probing methods including structural probing (which tests geometric organization of syntactic relationships), information-theoretic probing (which measures mutual information between representations and labels), and minimum description length probing (which penalizes complex probes to avoid capacity confounds). These methods provide converging evidence for the same general hierarchy while addressing different methodological concerns.

Practical takeaways for practitioners include the following guidance. When selecting intermediate representations for a downstream task, consider the linguistic level of that task and target the corresponding layers. Layer probing results inform adapter placement in parameter-efficient fine-tuning, suggesting that adapters targeting the layers most relevant to the downstream task should be more efficient than uniform distribution. Probing accuracy is correlational, not causal. Pair it with activation patching (covered in the next chapter) or gradient-based methods for causal conclusions. Always use simple probes (linear or minimal MLP) and compare against shuffled-label controls to ensure results reflect the representation, not the probe's capacity. Finally, be aware that residual connections mean later-layer probes may be reading information computed many layers earlier; probing layer deltas provides a cleaner measure of each layer's individual contribution.

The next chapter on Activation Patching will take interpretability further by letting us observe what information is encoded at each layer and actively intervene on specific activations to test whether they causally determine model behavior.