System Identification

Michael BrenndoerferJune 9, 20264 min read
World Models HandbookAll chapters
Part 2 of 12Inference, Decisions, and Control
Chapter 9System Identification
Reading section 1 of 11 · System Identification · 4 minSection 1 of 11 · 4 min

Section 1 of 11 · 4 min read

System IdentificationSection view · Sections in this chapter1 / 11 ↓
Reading tools Definitions, links & notes

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

Notes & comments

execute: cache: true jupyter: python3

Suppose you hand a robotics team thirty minutes of logged data from a prototype drone: commanded motor thrusts, accelerometer readings, gyro readings, timestamps. Nobody handed them a physics engine. Yet they need something that answers questions like "if we pulse the left rotor now, how will the roll angle respond over the next half second?" System identification is the discipline of building that something: starting from recorded trajectories of inputs and outputs, and recovering a predictive dynamical model of the system that produced them. The team's logs are passive records of what already happened; identification turns them into an active instrument, a simulator they can query about futures that have not occurred yet. That transformation, from a fixed record to an answerable counterfactual, is the entire point of the enterprise, and every technique in this chapter is a different route to it.

This sits in a specific place relative to the last chapter. In Bayesian Filtering and Belief States, we took the dynamics ff and observation function gg as given and inferred the hidden state as data streamed in. System identification flips the problem: the dynamics themselves are unknown, and we infer them offline from batches of data. You can think of filtering as running the world model forward with uncertainty, while identification is building the world model in the first place. In fact the two problems are duals in a precise sense: filtering assumes the model and estimates the trajectory state; identification assumes (noisily measured) trajectory evidence and estimates the model. Classical estimation theory couples them tightly: for a linear state-space model with Gaussian noises, the Kalman predictor supplies the conditional predictions evaluated inside the prediction-error method. Every model-based planner, controller, and agent discussed later in this book is downstream of this step. If Chapter 1 gave us MDPs and POMDPs as the grammar of sequential decision making, this chapter is about estimating the transition function that makes those formalisms usable. A planner written against a wrong transition function is not slow or suboptimal; it is confidently wrong, and this chapter exists largely to explain why that happens and how often to expect it.

We will work through four connected ideas. First, identifiability: which models can the data even distinguish, and what makes a dataset informative at all (excitation). Second, parametric identification: fitting a model with a fixed functional form and a finite parameter vector, culminating in the prediction-error method. Third, nonparametric and subspace methods: estimating dynamics directly as impulse responses or by realizing state-space matrices from data geometry. Fourth, neural system identification: replacing hand-picked function classes with learned networks, which connects classical practice directly to the modern world models of Part V and Part VI. These four ideas form roughly a historical arc as well as a conceptual one: identifiability theory and classical parametric methods matured through the 1960s and 1970s; nonparametric estimation and realization methods developed across the following decades; canonical subspace-identification algorithms emerged in the 1990s; and neural approaches have dominated the last decade. But the arc is not a story of progress leaving older ideas behind. As you will see, each generation inherits the same structural constraints, excitation requirements, and evaluation pitfalls, only wearing new clothes.

System Identification

System identification is the problem of selecting a dynamical model class and estimating its parameters from measured input-output or trajectory data, such that the resulting model reproduces the system's behavior well enough for the intended use: prediction, simulation, control design, or planning.

Notice that this definition quietly embeds a judgment call: "well enough for the intended use." There is no single universal criterion of model quality. A model good enough for simulating three steps ahead may be useless for planning twenty-step rollouts; a model matched to one operating regime may be dangerous in another. Throughout the chapter we will distinguish predictive fidelity (matching future outputs), representation quality (whether latent variables carry meaning), uncertainty quality (whether confidence intervals mean what they say), and decision usefulness (whether planners built on the model succeed). Collapsing these into one notion of "fit" is among the most common failure modes in applied work.

Comments

Add to the conversation

A question, a correction, or an example from your own work.

No comments yet. Be the first to share your thoughts!

Newsletter

Stay up to date

Get new articles, book updates, and notes on AI and technology.

Unsubscribe at any time. Privacy policy