Intellectual and Cognitive History › Four Lineages, One Idea
World Models HandbookAll chapters Intellectual and Cognitive History › Four Lineages, One IdeaOne section · Sections in this chapter3 / 13 ↓
Reading tools Definitions & inline links
Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.
Article links
Make inline references clickable
The term "world model" is used loosely across fields, and part of becoming fluent in this area is learning to hear which tradition a speaker is drawing from. A neuroscientist may mean a hippocampal map or cortical generative hierarchy; a control engineer, a plant model inside a controller; a reinforcement-learning researcher, learned transition dynamics; and a foundation-model researcher, a video generator or a language model's implicit physical knowledge. What Is a World Model? uses a narrower operational definition: a learned or constructed representation that predicts consequences of actions accurately enough to improve decisions. Some historical precursors below are broader predictive representations rather than complete action-conditioned world models under that definition. Their contribution is a component that later systems combine with action and decision machinery.
| Tradition | What the "model" is | What it is used for |
|---|---|---|
| Neuroscience & cognitive science | Neural machinery supporting prediction and simulation | Perception, motor control, memory, imagination |
| Cybernetics & control | Explicit equations of system dynamics | Regulation, tracking, disturbance rejection |
| AI planning & model-based learning | Hand-written operators in classical planning; learned transition and reward models in model-based learning | Search, lookahead, sample-efficient decision-making |
| Generative & foundation models | Large learned predictors of sensory or latent futures | Imagination, video generation, pretraining for control |
The table does not describe a monotonic march from narrow to general models. Each tradition chooses a modeled object for its own purpose. Neuroscience studies joint models of body and environment. Control theory models a particular plant, usually with equations derived or identified by engineers. Classical planners operate on task-specific symbolic operators, while model-based learning discovers task-relevant transition structure from experience. Foundation models learn from broad streams of sensory data before any one downstream task is fixed. The newest tradition therefore faces a particularly sharp version of an old question: what is the model for?
Two threads connect all four. First, prediction is often cheaper than action over the horizons that matter: evaluating a plan inside a model costs computation, while testing it in the world also costs time, energy, equipment, and sometimes survival. A slow or exceptionally detailed simulator can reverse that asymmetry, so it is a design constraint rather than a law. Where the asymmetry holds, it is the economic engine behind every tradition we visit. Evolution appears to have produced neural machinery that lets organisms learn without relying exclusively on dangerous trial and error. Engineers use simulators rather than letting a chemical plant fail while a controller learns. Reinforcement-learning agents use learned models when millions of real robot-hours would be impractical. Second, the model is never the world. Every tradition discovered, in its own vocabulary, that the gap between model and reality is where the interesting engineering lives. For Helmholtz, the gap was perceptual ambiguity resolved by priors. For Wiener, it was noise and delay that feedback had to absorb. In the Dyna lineage, it became model bias: planning inherits whatever errors the learned model contains, and simulated experience can propagate those errors into the policy, a compounding failure mode later model-based RL work made explicit. For today's video-generation debate, it is the difference between plausible footage and actionable physics. Keep both threads in mind as we proceed; nearly every development below is either a new way to buy cheap prediction or a new way to manage the model-world gap.