Intellectual and Cognitive History › What the History Teaches: Limitations and Impact

It is worth pausing on what this history does not show, because the failures are as instructive as the successes. Three related failure modes recur in different forms across the neuroscience, control, reinforcement-learning, and foundation-model discussions above. The parallels are conceptual rather than evidence that every field encountered an identical empirical failure. Recognizing the family resemblance is useful preparation for recognizing these problems in your own designs.

The first recurring failure is the gap between predicting and controlling. Helmholtz's perceiver, the Kalman filter, and Sora all predict; none of them, by itself, decides. Several traditions stalled when prediction quality was treated as sufficient for control. A video model can produce visually plausible sequences yet still lack the action interface and intervention data needed to answer controlled counterfactuals; this is a design risk, not a measured verdict about every video generator. The Smith predictor's dead-time compensation and MPC's receding horizon were earlier responses to the same underlying issue. The pattern is subtle because prediction quality does help control: a better predictive model makes every downstream decision better informed. But the help is bounded, and past the bound, additional predictive fidelity buys nothing that decisions can use. A video model that renders hair motion flawlessly may have spent capacity a particular planner cannot use. The discipline that resolves it, separating open-loop prediction quality from closed-loop decision usefulness, is exactly the discipline Chapter 3's four-criterion qualification test enforces.

The second recurring failure is model exploitation and compounding error. Dyna's planning amplifies whatever the model believes, right or wrong. MuZero reduces one source of burden by learning a representation for planning without reconstructing observations, while PILCO propagates predictive uncertainty through expected cost; neither removes model error. One-step errors accumulate differently depending on their structure. In an illustrative additive calculation, a constant signed bias of 0.01 per step sums to $0.01t$, while independent zero-mean errors with standard deviation 0.01 have root-mean-square sum $0.01\sqrt{t}$. State-dependent dynamics can contract or amplify either pattern. Uniformly sampled evaluation understates planner-facing error when the planner concentrates its queries in sparse, higher-error regions. That is the methodological point here; the relevant empirical check is error under the planner-induced state-action distribution.

The third lesson is about representation. Place cells, successor representations, MuZero's latents, and JEPA's embedding-space predictions all converge on the same conclusion: the useful model is not of observations but of a state abstraction that preserves what is predictable and decision-relevant. This is not an implementation detail; it is arguably the central design problem, and Part III is devoted to it. Notice that the convergence spans mechanisms as different as biological evolution, dynamic programming, and gradient descent, which is some evidence that the conclusion reflects the structure of the problem rather than the habits of any one community. What to keep, what to discard, and what granularity to predict at are choices that determine everything downstream: how much data the model needs, how far it can roll out, and whether its outputs can support decisions at all.

The impact side of the ledger is equally clear. Modern systems combine ideas from these traditions: action-conditioned prediction from motor neuroscience, state estimation and receding-horizon planning from control, learning through imagined experience from model-based RL, and generative pretraining at scale. Dreamer is one such composition: an encoder and recurrent belief state feed a stochastic latent dynamics model, and actor-critic learning uses imagined latent trajectories. That architecture echoes Helmholtzian inference, observer-style filtering, and Dyna's use of learned dynamics, but it is not literally any one of them. The assumptions can also conflict, as when a reconstruction objective favors perceptual detail while a planning objective favors decision relevance. The next chapter develops the mathematical foundations needed to reason about those choices: conditional distributions, states and transition laws, trajectories, stability and attractors, and information-theoretic sufficiency.