What Is a World Model? › Summary

This chapter established the conceptual foundation on which the rest of the handbook rests.

• A world model is defined operationally: a representation that predicts action-conditioned consequences accurately enough to improve decisions. Philosophical traditions from Craik and Tolman enrich this with questions of representation, grounding, and acquisition.
• Every world model decomposes into observations, state, dynamics, and agent structure (rewards, self-models, other-agent models). The Markov property defines what makes a state sufficient, and partial observability is the reason internal state estimation exists at all.
• Prediction and simulation are distinct activities: prediction estimates futures, simulation samples them, and recursive simulation compounds error. Open-loop accuracy is necessary but not sufficient for closed-loop usefulness; the operative standard is decision sufficiency.
• World models sit between generative models (which lack action-conditioning, intervention-consistency, or decision relevance) and simulators (whose dynamics are authored rather than learned, with privileged state access and no expressed uncertainty). The boundary is a gradient, and fitness for purpose ranks systems better than architectural sophistication does.
• The pendulum-behind-frosted-glass example demonstrated all of these ideas in code: learned linear dynamics, compounding rollout error, the penalty of partial observability, honest uncertainty through stochastic simulation, and the real cost of model bias in a closed loop.

If the chapter has a single sentence to carry forward, it is this: judge a world model by the decisions it improves, not by the futures it forecasts. Every evaluation method, architecture choice, and research debate in the coming chapters is a variation on applying that sentence rigorously.

The immediate question is how to tell a real world model from an impressive pretender. The next chapter, The World-Model Qualification Test, builds exactly that instrument: a battery of criteria, from rollout fidelity to intervention consistency, that any candidate model must pass before it deserves the name.