Data Sampling › Sampling Error and Uncertainty {#sampling-error-and-uncertainty}

Even when using rigorous probability sampling methods, sample statistics will differ from true population parameters due to random variation in which observations happen to be selected. This difference between a sample statistic and the true population parameter is called sampling error.

Sampling error is not a mistake or fault in methodology but rather an inherent consequence of observing only part of the population. If we drew many different samples from the same population using the same sampling method, each would yield a slightly different sample mean, proportion, or other statistic. The sampling distribution describes the distribution of a statistic across all possible samples of a given size.

Understanding sampling distributions allows us to quantify uncertainty through standard errors and confidence intervals. The standard error measures the typical magnitude of sampling error: how much we expect sample statistics to vary around the true population parameter. Larger samples generally produce smaller standard errors.

The margin of error in opinion polls and surveys directly reflects sampling uncertainty, typically calculated as approximately two standard errors. When a poll reports 52% support with a margin of error of ±3%, this indicates that if we repeated the sampling process many times, roughly 95% of sample proportions would fall between 49% and 55%, assuming the same sampling methodology.

Distinguishing sampling error from other sources of error in data analysis is important. Non-sampling errors include measurement errors, nonresponse bias (when certain groups systematically fail to respond), coverage errors (when the sampling frame excludes parts of the population), and processing errors. Unlike sampling error, which decreases predictably with larger samples, non-sampling errors may not improve with increased sample size and sometimes worsen as data collection becomes more complex.