Confidence Intervals and Test Assumptions › Summary

Michael BrenndoerferUpdated January 12, 20261 min read
Machine Learning from ScratchAll chapters
Part 2 of 9Hypothesis Testing
Chapter 13Confidence Intervals and Test Assumptions › Summary
Reading section 7 of 9 · Summary · 1 minSection 7 of 9 · 1 min

Book contents

Section 7 of 9 · 1 min read

Confidence Intervals and Test Assumptions › SummaryOne section · Sections in this chapter7 / 9 ↓
Reading tools Definitions & inline links

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

This chapter covered two essential complementary topics:

Confidence Intervals and Their Equivalence to Hypothesis Tests

  • A 95% CI contains all parameter values that would not be rejected at the 0.05 level
  • CIs are more informative than p-values because they show the range of plausible values
  • CI width communicates precision: narrow intervals indicate precise estimates

Test Assumptions

  • Independence: The most important assumption. Violations lead to inflated Type I errors.
  • Normality: The CLT makes this less critical for large samples (n > 30), but small samples require caution
  • Equal variances: Use Welch's t-test as your default for two-sample comparisons

Choosing Between Tests

  • Use t-tests when σ\sigma is unknown (almost always)
  • Use Welch's t-test as the default for two-sample comparisons
  • The z-test is appropriate only when you know σ\sigma from prior information