Taxonomies of World Models › Why Classification Matters

Before diving into the axes, it is worth asking why a taxonomy earns its keep. Three reasons stand out.

First, taxonomies expose tradeoffs. Every choice along each axis buys something and costs something. Pixel-level models preserve maximal information but make dynamics learning brutally hard. Latent models make dynamics easy but risk discarding exactly the information your task needs. Naming the axes turns vague anxiety ("will my representation lose something important?") into concrete engineering questions. Once you know that the question is "where does abstraction happen, and what does it cost?", you can inspect a candidate architecture and ask precisely which information its bottleneck preserves, which it destroys, and whether the destroyed part matters for your reward function, your safety constraints, or your evaluation metrics.

Second, taxonomies prevent false debates. When one researcher says "world models need object structure" and another says "end-to-end latent models work fine," they are often arguing about different points on the state axis while tacitly assuming different tasks, different data budgets, and different control regimes. A shared vocabulary makes the actual disagreement visible. Many celebrated controversies in the field dissolve once you notice that the participants were optimizing different quantities: one cared about sample efficiency in a low-data regime, another about asymptotic performance with unlimited data, and a third about interpretability for human operators. None of these goals is wrong, but a model cannot be ranked without saying which goal governs.

Third, taxonomies connect modern systems to classical ones. A latent dynamics model trained with gradient descent and a state-space model identified with subspace methods in Part II are answers to the same question posed with different tools. Seeing the continuity helps you import sixty years of theory, including observability, controllability, and identifiability, into modern settings where those words rarely appear. A learned encoder mapping observations to latent vectors is doing work that classical estimation theory would describe as constructing an observer, and questions like "can two distinct physical states produce identical observation histories?" apply to both with equal force. Similarly, the stochastic models we discuss below descend directly from the Kalman filter's treatment of process noise, and the compounding-error analysis we revisit descends from classical stability theory for closed-loop control under model mismatch.

A fourth reason deserves mention alongside these three: taxonomies separate kinds of model quality that practitioners frequently conflate. A model can be predictively accurate yet representationally poor, meaning its outputs match reality while its internal variables support no useful reasoning. It can be well calibrated yet decision-useless, meaning its uncertainty estimates are honest but too coarse to act on. And it can excel at one-step fidelity while failing catastrophically at multi-step rollouts. Throughout this chapter we will flag which axis affects which kind of quality, because confusing them leads to the most common evaluation mistakes in the field.

With that motivation, let us take the axes one at a time.