Gauss-Markov Assumptions › Mathematical Foundation
Michael BrenndoerferMay 22, 20251 min read
Machine Learning from ScratchAll chapters Part 3 of 9Foundations
Gauss-Markov Assumptions › Mathematical FoundationOne section · Sections in this chapter4 / 11 ↓
Sections in this chapter11
Reading tools Definitions & inline links
Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.
Article links
Make inline references clickable
The Gauss-Markov theorem can be stated mathematically as follows:
Theorem: Under assumptions 1-5, the OLS estimator is the best linear unbiased estimator (BLUE) of .
This means:
- Unbiased:
- Efficient: is the smallest among all linear unbiased estimators
- Consistent: As sample size increases, converges to the true
The OLS estimator is given by:
Where:
- is the matrix of independent variables
- is the vector of dependent variable
- is the vector of estimated coefficients