Confidence Intervals and Test Assumptions › Summary
Michael BrenndoerferUpdated January 12, 20261 min read
Machine Learning from ScratchAll chapters Part 2 of 9Hypothesis Testing
Confidence Intervals and Test Assumptions › SummaryOne section · Sections in this chapter7 / 9 ↓
Sections in this chapter9
Reading tools Definitions & inline links
Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.
Article links
Make inline references clickable
This chapter covered two essential complementary topics:
Confidence Intervals and Their Equivalence to Hypothesis Tests
- A 95% CI contains all parameter values that would not be rejected at the 0.05 level
- CIs are more informative than p-values because they show the range of plausible values
- CI width communicates precision: narrow intervals indicate precise estimates
Test Assumptions
- Independence: The most important assumption. Violations lead to inflated Type I errors.
- Normality: The CLT makes this less critical for large samples (n > 30), but small samples require caution
- Equal variances: Use Welch's t-test as your default for two-sample comparisons
Choosing Between Tests
- Use t-tests when is unknown (almost always)
- Use Welch's t-test as the default for two-sample comparisons
- The z-test is appropriate only when you know from prior information