Data Sampling › Population versus Sample {#population-versus-sample}

Michael BrenndoerferMay 16, 20252 min read
Machine Learning from ScratchAll chapters
Part 1 of 9Statistics 101
Chapter 5Data Sampling › Population versus Sample {#population-versus-sample}
Reading section 3 of 10 · Population versus Sample {#population-versus-sample} · 2 minSection 3 of 10 · 2 min

Book contents

Section 3 of 10 · 2 min read

Data Sampling › Population versus Sample {#population-versus-sample}One section · Sections in this chapter3 / 10 ↓
Reading tools Definitions & inline links

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

At the heart of sampling theory lies the distinction between a population and a sample. The population represents the complete set of all individuals, items, or observations about which we want to draw conclusions. This might be all registered voters in a country, every transaction in a database, or all possible measurements from a manufacturing process. The population defines the scope of our inference: the group to which our conclusions should apply.

In contrast, a sample consists of the subset of observations we collect and analyze. When we survey 1,000 voters from a population of millions, conduct quality tests on 100 products from a production run of 10,000, or analyze data from 500 customers out of a customer base of 100,000, we are working with samples. The sample is a window into the population.

Population characteristics are described by parameters, which are fixed but typically unknown values such as the true population mean (μ\mu) or population proportion (pp). Sample characteristics are described by statistics, which are calculated values such as the sample mean (xˉ\bar{x}) or sample proportion (p^\hat{p}) that we compute from observed data. A fundamental goal of statistical inference is to use sample statistics to estimate population parameters and quantify our uncertainty about those estimates.

The relationship between samples and populations introduces a key challenge: samples rarely perfectly mirror their parent populations. Random variation means that different samples from the same population will yield different statistics, a phenomenon known as sampling variability. Understanding and accounting for this variability forms the basis of inferential statistics and confidence interval construction.