Intellectual and Cognitive History › Cybernetics: Purpose, Feedback, and the First Artificial Regulators

While psychologists were inferring internal models from behavior, engineers were building external ones. This tradition contributed mathematics that the rest of the book runs on. The next chapter develops states, transition laws, trajectories, stability, and information-theoretic sufficiency; Part II later develops feedback and observers. Here we focus on how engineers came to put prediction inside controllers that operate under delay and uncertainty. Better sensors and faster actuators help in many regimes. They do not remove a substantial transport delay, however, and aggressive feedback across such a delay can destabilize the loop. In delay-dominated problems, prediction lets the controller act on where the system will be rather than only where it was when the measurement was produced. The goalkeeper from this chapter's opening is the biological version; the Smith predictor is the engineered archetype.

The story begins with an engineering embarrassment. In the 1860s, centrifugal governors that regulated steam engines (seemingly simple devices that throttle an engine when it speeds up) could oscillate badly on faster machines. Practitioners had empirical remedies, and Airy had analyzed the dynamics of a clockwork regulator for telescope drives in 1840, but there was no satisfactory general theory of feedback-loop behavior. James Clerk Maxwell's 1868 paper "On Governors" supplied the first systematic stability analysis of a broad class of governors. He showed that stability depends on the dynamics of the whole closed loop, not on the governor alone. A component that is well-behaved in isolation can destabilize a loop, while a loop containing an imperfect component can remain stable if its dynamics are arranged correctly. The lesson that the loop is the unit of analysis echoes through this book, from rollout divergence in learned models to receding-horizon control.

The conceptual leap came during World War II. Artillery had to hit moving aircraft, which meant predicting where the target would be when the shell arrived under noisy tracking. Pure reaction was too late, and naive extrapolation was fragile. This wartime prediction problem also drove Wiener's work on statistical prediction and filtering. Arturo Rosenblueth, Norbert Wiener, and Julian Bigelow addressed a related conceptual question in "Behavior, Purpose and Teleology" (1943): how to describe purposeful behavior without invoking a mysterious final cause. They argued that feedback gives purpose in animals and machines a mechanistic account. Wiener's 1948 book Cybernetics, subtitled "Control and Communication in the Animal and the Machine," named the field and argued that the same mathematics could illuminate thermostats, artillery trackers, and nervous systems. W. Ross Ashby's Design for a Brain (1952) treated adaptive behavior as regulation; his later An Introduction to Cybernetics (1956) stated the law of requisite variety, the more precise source for the claim that a regulator must match the relevant variety of its environment.

Cybernetics as a movement faded in the 1960s and 1970s, partly because its ambitions outran its tools. The mathematics of nonlinear, high-dimensional, uncertain systems did not yet exist, and the movement's grandest claims about society and cognition could not be cashed out. But its two central gifts survived intact. The first is the feedback loop as a unit of analysis: the insight that behavior arises from circular causality between a system and its environment, and that this circularity must be analyzed as a whole. The second is the recognition that regulation under delay and noise requires an internal representation of the regulated system. That recognition was about to be made precise.

Classical feedback control reacts to errors after they appear. Measure the output, compare it to the target, correct. That works when the loop is fast relative to the process. But many processes have long dead time: a shower where the water temperature responds seconds after you turn the knob, or a paper mill where a change at one end takes minutes to affect the other. Under dead time, aggressive or high-gain feedback can oscillate because the visible effect of the last action arrives late and the next correction targets an already changed situation. Low-gain feedback may remain stable but respond sluggishly. Anyone who has adjusted a shower temperature in waves of too hot and too cold has experienced the first regime.

Otto Smith's 1957 Smith predictor made the fix explicit: keep a model of the process inside the controller, simulate the effect of your control action on the model (which responds immediately, with no dead time), and base feedback on the model's immediate output, correcting it whenever a measurement arrives by comparing that measurement against the model's own delayed prediction. The controller regulates a prediction of the process rather than reacting to stale measurements directly. With an accurate process model, the dead time is moved outside the nominal feedback characteristic equation; model mismatch reintroduces delay sensitivity and limits robustness. This is an early, fully explicit instance of the pattern this book is about: a model inside the loop, serving as a fast surrogate for a slow world.

The 1960s generalized this from a trick to a theory. Rudolf Kálmán's 1960 filter solved a problem every world model faces: estimate an evolving state from noisy measurements. With linear dynamics, mutually independent Gaussian process and measurement noise, and a Gaussian initial state independent of both noise sequences, the Kalman recursion gives the minimum-mean-square-error estimate. If Gaussianity is replaced by finite second moments while those zero-mean, independence, and covariance assumptions are retained, the same recursion gives the best linear estimator. The filter maintains a mean and covariance and alternates between prediction through the model and correction from measurements. Prediction propagates belief and adds process uncertainty; correction contracts uncertainty according to measurement informativeness. David Luenberger's 1964 observer treated deterministic linear systems without requiring noise statistics. Its estimation error converges whenever the chosen observer gain makes the error dynamics stable; such a stabilizing gain exists precisely when the system is detectable. The obstruction is an unobservable unstable mode, not unobservability by itself, because unobservable modes that are already stable can decay without correction. In both methods, the internal model determines how prediction and observation are combined. This observer construction is distinct from the Francis-Wonham internal model principle of 1976, which concerns embedding disturbance or reference dynamics in a regulator.

The step-18 dashed line is intentionally difficult to separate from the solid trace. Once the disturbance ends, the measured state reanchors the rollout and the toy's internal dynamics again match the plant. That near-overlay is the recovery signal, not a missing third plan.

The next result is narrower than its memorable title suggests: it concerns a specific optimal-regulation setting and a correspondence between distinguishable regulator and system states.

In 1970, Roger Conant and W. Ross Ashby published a theorem with a provocative title: "Every good regulator of a system must be a model of that system." Their setting is specific: a deterministic system driven by stochastic disturbances, an objective that minimizes uncertainty in specified essential variables, and an optimal regulator considered in reduced form, without redundant distinguishable states. In that setting, the regulator's distinguishable states correspond homomorphically to distinguishable situations of the regulated system. A lookup table can meet this criterion when its indices distinguish the relevant situations and its stored outputs select actions; the model need not be a rich predictive simulator. Describing this as an estimator followed by a policy is a useful modern interpretation, not the theorem's literal statement.

The theorem should not be over-read. It does not say that the model must be explicit, learned, inspectable, or capable of multi-step simulation. Nor does it imply that every fixed-gain, memoryless controller contains a nontrivial model; only degenerate cases can satisfy a multi-state correspondence with a single undifferentiated controller state. As a design intuition, the theorem remains useful: in its setting, optimal regulation requires a correspondence between regulator states and the system distinctions relevant to the essential variables. That is narrower than the Francis-Wonham internal model principle and far narrower than a universal claim about brains or policies. The form and richness of the correspondence remain engineering choices.