R-squared › When R-squared is Misleading

Michael BrenndoerferApril 4, 20251 min read
Machine Learning from ScratchAll chapters
Part 3 of 9Foundations
Chapter 24R-squared › When R-squared is Misleading
Reading section 9 of 12 · When R-squared is Misleading · 1 minSection 9 of 12 · 1 min

Book contents

Section 9 of 12 · 1 min read

R-squared › When R-squared is MisleadingOne section · Sections in this chapter9 / 12 ↓
Reading tools Definitions & inline links

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

R-squared can be misleading in several scenarios. For nonlinear relationships, R-squared assumes linearity and might be low even when the model captures the true relationship well. Outliers can dramatically affect R-squared, making it unreliable for overall model performance. When variance changes across the prediction range (heteroscedasticity), R-squared might not reflect true model quality. Overfitting can make R-squared artificially high when the model has too many parameters relative to observations. Finally, with very small sample sizes, R-squared can be unstable and misleading.