Intellectual and Cognitive History › Summary

• The four lineages contributed different working tools and exposed different limits. Neuroscience supplied prediction, simulation, and state-like representations but also showed context dependence and ambiguity. Control supplied feedback, estimation, and receding horizons but made model mismatch explicit. Symbolic planning and model-based RL supplied search and imagined updates but exposed hand-authored-model brittleness and learned-model bias. Generative and foundation models supplied scale but sharpened the distinction between plausible prediction and decision-useful, action-conditioned dynamics.
• The idea of internal models is old and convergent. Helmholtz's unconscious inference, von Holst and Mittelstaedt's efference copies, Tolman's cognitive maps, and predictive processing all use internal models to explain prediction under partial observation. Tolman's and later predictive-processing traditions extend this core toward simulation and planning, while efference-copy accounts emphasize predictions tied to the self's actions. Their convergence across distinct but partly connected literatures suggests that internal prediction addresses a recurring problem of acting with incomplete observations.
• Control theory made the intuition exact under stated assumptions. The Smith predictor, Kalman filter, Luenberger observer, and MPC showed how a model can support regulation under delay and noise, while Conant and Ashby formalized an internal state correspondence for optimal regulation in their setting. Receding-horizon replanning is one battle-tested way to limit open-loop trust in an imperfect model; robust MPC and other uncertainty-aware methods add stronger guarantees.
• Classical AI planning supplied explicit models and search; model-based reinforcement learning added learning from interaction. Samuel's backups, Dyna's replayed model transitions, MuZero's planning representation, and Dreamer's latent imagination are related but distinct ways to convert predictions into better decisions. Their benefit is bounded by the accuracy and support of the learned model.
• The foundation-model era changed the scale, not the questions. Generative video models, JEPA-style latent predictors, and world-action models are new instantiations of the same design axes: what to predict, in which space, conditioned on which actions, and evaluated for which use. Scale shifts where the trade-offs bite; it does not remove them.
• The Dyna experiment makes the economics concrete. In the deterministic twenty-seed execution, Dyna reaches the displayed return threshold with fewer real interactions than Q-learning. The labeled planning-depth sweep records how that interaction cost changes; because crossings are measured on a 50-step grid, one-interval differences should not be overinterpreted.
• The recurring failure modes concern representation, knowledge, and sequential dynamics: confusing prediction quality with decision usefulness, exploiting model errors, and compounding rollout error. Many design decisions in the rest of this book respond to one or more of these problems.

For our purposes, the historical case is established: models help agents predict, infer, and plan, but only under conditions that the next chapters will make explicit. The next chapter builds the machinery for conditional prediction, state transitions, trajectories, stability, and sufficient representations.