R-squared › Adjusted R-squared

Michael BrenndoerferApril 4, 20251 min read
Machine Learning from ScratchAll chapters
Part 3 of 9Foundations
Chapter 24R-squared › Adjusted R-squared
Reading section 6 of 12 · Adjusted R-squared · 1 minSection 6 of 12 · 1 min

Book contents

Section 6 of 12 · 1 min read

R-squared › Adjusted R-squaredOne section · Sections in this chapter6 / 12 ↓
Reading tools Definitions & inline links

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

When dealing with multiple regression, the standard R-squared can be misleading because it always increases (or stays the same) when adding more predictors, even if those predictors don't improve the model. Adjusted R-squared accounts for the number of predictors using the formula Radj2=1−(1−R2)(n−1)n−p−1R^2_{\text{adj}} = 1 - \frac{(1-R^2)(n-1)}{n-p-1}, where nn is the number of observations and pp is the number of predictors. Unlike standard R-squared, adjusted R-squared can decrease when adding irrelevant predictors.