Michael Brenndoerfer | Data & AI, Private Equity, Technology

Michael Brenndoerfer

Central Limit Theorem › How Large Should n Be?

Michael BrenndoerferUpdated January 5, 20263 min read

Machine Learning from ScratchAll chapters

Part 1 of 9Statistics 101

Chapter 4Central Limit Theorem › How Large Should n Be?

Reading section 5 of 8 · How Large Should n Be? · 3 minSection 5 of 8 · 3 min

Section 5 of 8 · 3 min read

Central Limit Theorem › How Large Should n Be?One section · Sections in this chapter5 / 8 ↓

Sections in this chapter8

Reading tools Definitions & inline links

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

A common practical question is: how large must the sample size be for the Central Limit Theorem to apply? The answer depends on the shape of the original population distribution. For populations that are already approximately normal, even small sample sizes like $n = 5$ or $n = 10$ can produce sample means that are approximately normally distributed. For symmetric but non-normal distributions, moderate sample sizes around $n = 30$ are typically sufficient.

However, when the population distribution is highly skewed or has heavy tails, larger sample sizes may be required before the sample means converge to normality. In cases of extreme skewness, sample sizes of $n = 100$ or more might be necessary. The conventional rule of thumb that $n \geq 30$ is sufficient for the CLT to apply should be viewed as a guideline rather than a hard requirement, and you should consider the shape of your data when determining appropriate sample sizes.

The following example demonstrates how the distribution of sample means becomes increasingly normal as sample size increases, starting from a highly skewed exponential distribution:

Out[3]:

Visualization

Histogram of original exponential population distribution. — Original exponential population distribution (highly right-skewed). This represents the true underlying distribution from which we draw samples, characterized by a long right tail and concentration of values near zero.

Histogram of sample means with n=5 showing partial convergence to normal. — Distribution of sample means with n=5. While the right skew is still visible, the distribution has already begun to shift toward a more symmetric, bell-shaped form. The means are more concentrated around the population mean compared to individual observations.

Histogram of sample means with n=30 showing strong convergence to normal. — Distribution of sample means with n=30. The distribution now closely approximates a normal distribution despite the original population being exponential. This demonstrates the Central Limit Theorem in action, showing how larger sample sizes produce sample means that converge to normality.