Structured Simulators and Neural Operators › Limitations and Impact

The deepest limitation of every method in this chapter is that structure is a wager on where the model will be used. A differentiable simulator is accurate only inside the regime its equations describe; a graph network's learned interaction law assumes coverage of relevant pair configurations; an operator trained on one family of initial conditions may degrade outside it. Agents that optimize through these models can find the seams. A policy may exploit compliant contact in ways a real robot cannot, while an operator-based planner may seek inputs where prediction error flatters its objective. Structure narrows the space of plausible failures, but it does not eliminate model exploitation. Part XII returns to these reliability questions.

The second systemic limitation concerns evaluation. These families are often evaluated on held-out predictive error---trajectory or rollout error for dynamical models, and field or function error for operator models---but predictive error alone does not establish usefulness for control. As we saw in the worked example, open-loop accuracy and closed-loop usefulness can come apart. A simulator whose parameters are slightly wrong may produce visually indistinguishable trajectories while inverting the sign of a gradient that planning depends on; a graph model with excellent one-step accuracy may drift over horizons that matter for a task. Structured models earn their complexity budget only when the structure they encode is the structure the decision problem exercises, and evaluating that requires task-level protocols, not just predictive-error metrics. In practice this means evaluating plans executed under model mismatch, not just predictions compared to data, and it means reporting where in state space the model is trustworthy, not just how wrong it is on average.

The impact of these methods has been substantial. Differentiable simulators connect system identification, optimal control, and deep learning. Graph simulators have shown that learned local updates can model particle and mesh systems, and GraphCast-style models scale relational structure to planetary forecasting. Neural differential equations connect learned dynamics to dynamical-systems analysis, while operator learning targets reusable PDE solution maps. Each capability remains conditional on the encoded structure, numerical method, data regime, and deployment distribution.

One more frontier remains deliberately open in this chapter. Every model here produced a deterministic prediction. Physical prediction is uncertain because chaotic dynamics amplify initial-state uncertainty, contact conditions and parameters are imperfectly known or variable, and sensors are noisy; only some of these mechanisms are intrinsically stochastic. Representing aleatoric, epistemic, and observation uncertainty changes both training objectives and how a planner should consume predictions. A predictive distribution can support risk-aware decisions, provided it is calibrated in the relevant state-action region. That is the subject of the next chapter on stochasticity and uncertainty.