What Is a World Model? › Two Ways to Define a World Model

There are two complementary answers to "what is a world model?", and mature practitioners hold both at once. The first is an engineering specification: a functional contract the model must satisfy. The second is a scientific and philosophical claim about what it means for a mind or a machine to carry a model of the world at all. The two traditions ask different questions, use different vocabularies, and occasionally disagree about borderline cases, which is precisely why holding both is valuable. An engineer who ignores the philosophical tradition builds systems that predict without representing; a philosopher who ignores the operational test praises systems that represent without predicting anything useful.

The operational definition treats "world model" as a role, not an object. Anything that plays the role counts, regardless of its internal machinery. This is the same move biology makes when it defines a wing by what it does for flight rather than by what it is made of: feathers, membranes, and engineered airfoils are all wings because they all generate lift. By analogy, a lookup table, a differential equation, and a recurrent neural network are all world models if they all support action-conditioned prediction good enough for control.

Every word in that definition is doing work. Let us unpack the three clauses that matter most.

It predicts consequences of actions. A passive forecaster of tomorrow's weather is a predictor, but a world model answers counterfactual, action-conditioned questions: what would happen if I did this? Formally, if the environment is a system with state $s_t$, actions $a_t$, and transitions governed by some true dynamics $p(s_{t+1} \mid s_t, a_t)$, the agent's world model maintains an approximation $\hat{p}_\theta(s_{t+1} \mid s_t, a_t)$, together with auxiliary pieces we will catalog shortly. The conditioning on $a_t$ is what separates a world model from a mere video forecaster, and we will return to this boundary later in the chapter. It is worth pausing on how demanding this clause really is. A passive forecaster only needs to be right about the futures that actually happen, weighted by how often they happen. An action-conditioned model must be right about futures that never happen, including futures under actions nobody has ever taken, because planning requires evaluating actions before committing to them. The model must extrapolate across the space of actions, not merely interpolate across the stream of time.

"Accurately enough" is relative to decisions. Perfection is neither achievable nor required. A chess player's mental model of the board is wildly incomplete as physics, yet superb for choosing moves. An error that shifts a long-horizon forecast by a millimeter may be irrelevant; a small bias in braking-distance estimation may be fatal. This is why the operational definition refuses to specify a universal accuracy threshold. The right threshold is set by the decisions downstream, a principle we will formalize as decision sufficiency below. Think of accuracy as a budget to be spent where it matters. A warehouse robot's world model can be sloppy about the color of boxes and sloppy about positions beyond its reach, but it had better be precise about gripper trajectories near shelving. Every modeling choice allocates finite data, capacity, and attention somewhere, and the operational definition says: allocate them toward the decisions.

It improves decisions made with it. This clause excludes systems that predict beautifully but mislead their planners. A model can have low prediction error on the data distribution and still cause catastrophic failure when an optimizer searches for actions that exploit its blind spots. The gap between predicting well and deciding well is one of the central tensions of model-based reinforcement learning, and it will recur throughout Part VI and Part VII of this handbook. If you remember only one sentence from this chapter, make it this one: the value of a world model is realized only through the closed loop, and closed-loop value is a different quantity from open-loop accuracy.

Under this definition, the term deliberately spans an enormous range: a one-step linear regression used by a controller, a recurrent latent dynamics network imagined forward by Dreamer-style agents, a monkey's grasp of where a thrown ball will land, and a full physics engine. They differ wildly in fidelity, scope, and mechanism, but they occupy the same functional role. This breadth is a strength, not a sloppiness. It lets us transfer insights across scales: lessons learned from fitting a linear model to fifty seconds of pendulum data reappear, transformed but recognizable, in the training of planetary-scale video predictors.

The second tradition asks a deeper question: what does it mean for an organism to have a model of the world? This lineage is older than machine learning. Kenneth Craik argued in The Nature of Explanation (1943) that thought works by carrying a "small-scale model" of external reality inside the head, allowing an organism to try out alternatives, anticipate outcomes, and react to future situations before they arrive. Craik's phrase deserves attention: he described the mental model as small-scale, meaning not a copy of the world but a compressed, manipulable surrogate, cheap enough to run many experiments in quickly. That compression-versus-fidelity trade-off is exactly the trade-off you will face when choosing the dimensionality of a learned latent state. Edward Tolman's experiments on rats (1948) suggested that animals navigating mazes acquire cognitive maps, structured representations of spatial layout that go beyond stimulus-response habits. Tolman's rats took shortcuts to rewards they had never traveled to directly, behavior that could not be explained by memorized stimulus-response chains and demanded something map-like inside the animal. Later theorists such as Johnson-Laird developed these ideas into the "mental models" framework in cognitive psychology, studying how people reason about physical systems, deductive problems, and other minds by constructing and inspecting internal surrogates.

On this view, a world model is characterized less by what it does for a controller and more by what it represents: entities, relations, causal structure, and the way they unfold in time. This raises questions the operational definition happily ignores:

• Representation: Is the model a literal analog of the world's structure, or an arbitrary internal code that merely behaves as if it were? A map drawn to scale and a set of driving directions encode the same city differently, and both work. Whether internal codes must resemble the world, or merely serve it, remains contested.
• Grounding: How do the model's symbols connect to sensory experience and physical reality? A symbol that never touches observation is speculation; grounding is the discipline that ties representation to evidence.
• Scope: Does the model cover the observer's own body and mind, other agents, or only the inert environment? Human models conspicuously include the self and other people, and much of human competence depends on that inclusion.
• Acquisition: Is the model innate, learned from experience, or some interplay of both? Infants appear to arrive with priors about objects and solidity, then refine them dramatically through interaction, suggesting the answer is rarely either extreme.

You do not need to resolve these questions to build useful systems, and this handbook is primarily operational. But the philosophical tradition matters for two practical reasons. First, it explains why the field expects certain properties, like compositional generalization and causal robustness, from advanced world models: those are properties of human mental models that purely correlational predictors lack. When we demand that a model handle novel combinations of familiar elements, we are importing an expectation born from watching minds do it. Second, it supplies the vocabulary in which much of the research frontier is argued, especially in cognitive science collaborations and discussions of foundation models in Part IX: Foundation and World-Action Models. Reading that literature without the Craik-Tolman lineage is like reading physics without knowing what "energy" meant before thermodynamics formalized it.

Throughout this book we will move between the two registers. When we say a model "is a world model," we usually mean the operational test. When we ask whether a model "understands" its world, we are invoking the philosophical one. Keeping the registers distinct prevents a common species of pointless argument, in which one party applies the functional test and the other the representational one, and both leave convinced the other missed the point. The next chapter, The World-Model Qualification Test, turns the operational definition into concrete criteria a candidate model must pass.