Linear Algebra for Quantitative Finance › Limitations and Practical Considerations

Linear algebra provides clean solutions, but real-world implementation requires caution around several issues.

In high-dimensional covariance estimation, estimation error is a major challenge. Covariance matrices estimated from historical data are noisy, especially with many assets relative to the number of observations. A 500-stock universe with 252 days of data has 125,250 unique covariance entries and 126,000 scalar returns, but those scalar values come from only 252 multivariate observations and are not independent information for each covariance entry. The sharper limitation is structural: a centered sample covariance based on $T$ observations has rank at most $T-1$, so it is singular when the number of assets $N$ is at least $T$. This leads to unstable or nonexistent matrix inverses and portfolio weights that can swing wildly with small changes in the data. Practitioners address this through shrinkage estimators, factor models, and regularization techniques that we'll explore in later chapters.

Numerical stability compounds the estimation problem. Positive definite covariance matrices with widely separated eigenvalues, especially a near-zero smallest eigenvalue, have high condition numbers and make linear solves sensitive to perturbations. Double-precision floating point arithmetic can introduce errors that propagate through calculations. Prefer direct solves to explicit inverses, and check rank and condition numbers first. An SVD-based pseudoinverse is useful when singular values are truncated or regularized; an exact pseudoinverse that reciprocates tiny retained singular values can still amplify noise.

Non-stationarity presents a major challenge to our matrix-based models. The covariance structure of asset returns shifts over time as market conditions change. A covariance matrix estimated during calm markets can underestimate risk during crises. This is exactly when accurate risk measurement matters most. Rolling window estimation, exponentially weighted covariance, and regime-switching models attempt to capture time-varying structure, but their forecasts remain subject to model and estimation error.