R-squared › Common Misconceptions

Michael BrenndoerferApril 4, 20251 min read
Machine Learning from ScratchAll chapters
Part 3 of 9Foundations
Chapter 24R-squared › Common Misconceptions
Reading section 8 of 12 · Common Misconceptions · 1 minSection 8 of 12 · 1 min

Book contents

Section 8 of 12 · 1 min read

R-squared › Common MisconceptionsOne section · Sections in this chapter8 / 12 ↓
Reading tools Definitions & inline links

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

Several misconceptions about R-squared are widespread. First, higher R-squared isn't always better.a model with R2=0.99R^2 = 0.99 might be overfitted and perform poorly on new data. Second, R-squared doesn't indicate causation, only correlation. Third, R-squared of 0.3 isn't always bad.context matters, as social sciences might consider this excellent while physics would find it poor. Fourth, R-squared doesn't work for all model types.it's designed for linear regression, and logistic regression requires pseudo-R-squared measures.