Intellectual and Cognitive History › Why World Models?

Watch a goalkeeper dive to stop a penalty kick. From the instant of contact, a firmly struck ball can cross the eleven meters from the penalty mark to the goal in roughly half a second. Flight time depends on shot speed: at roughly 22 to 32 meters per second, the simple estimate $t = 11/v$ gives about 0.34 to 0.50 seconds. A goalkeeper cannot wait for the full flight, interpret it, choose a direction, and then move across most of the goal. Instead, the goalkeeper uses early visual cues to anticipate where the ball will be, a behavior studied directly in in-situ penalty experiments. This is usefully modeled as a short-horizon internal simulation of a physical system, run forward from partial and noisy observations. The goalkeeper must commit the body's gross trajectory before takeoff, while vision can still guide smaller adjustments of the limbs during the dive.

Notice how much is packed into this single everyday act. The goalkeeper's brain maintains an estimate of the ball's position and velocity from delayed, noisy visual evidence. It extrapolates that state through learned regularities of ball flight, while coping imperfectly with aerodynamic effects such as drag and spin, and evaluates candidate interception points against the body's reach, momentum, and the geometry of the goal. Because the flight is so short, takeoff largely fixes the body's center-of-mass trajectory even though limb configuration can still be adjusted. Unlike the full receding-horizon controllers we meet later, the goalkeeper commits the body's gross trajectory early and adjusts only locally afterward. Its engineering counterparts are state estimation, forward prediction, and planning under constraints. The penalty kick is a world-model problem wearing athletic clothing.

This chapter tells the story of that idea. It is not a museum tour. Each of the four traditions contributed something that appears in many modern world models, and each exposed a failure mode that modern systems still face. Neuroscience and cognitive science supplied evidence and concepts for internal prediction and simulation. Cybernetics and control engineering supplied mathematics for state, feedback, observers, and optimal control over predicted futures. Classical AI planning supplied explicit models and search over their consequences; model-based reinforcement learning added the problem of learning models from interaction. The modern generative and foundation-model era supplied scale through predictors of rich sensory and latent futures.

We will move through these lineages roughly in historical order, but the point is not chronology. The point is that when you design a world model today, you are recombining decisions that these communities wrestled with for decades. Knowing where each idea came from tells you which assumptions it carries. Cognitive accounts assume that prediction error is a useful organizing signal. A latent dynamics model inherited from control theory assumes that a compact state exists and suffices. A generative video predictor inherited from computer vision assumes that matching sensory statistics is a useful training target. A Dyna-style planner inherited from reinforcement learning assumes that simulated experience can substitute for real experience. None of these assumptions is free, and the history below records where each has helped and where it has failed.