Descriptive Statistics › Practical Applications
Machine Learning from ScratchAll chapters Descriptive Statistics › Practical ApplicationsOne section · Sections in this chapter8 / 11 ↓
Reading tools Definitions & inline links
Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.
Article links
Make inline references clickable
Descriptive statistics are widely useful across data science and analytics:
- Quality Control Manufacturing: Control charts monitor process statistics over time and flag patterns that warrant investigation [12]. Their control limits describe expected process variation and are not the same as engineering specification limits, so a statistically stable process can still produce items outside specification [13].
- Healthcare Research: Survival quantiles can summarize treatment outcomes, but censoring must be handled with a survival estimator such as Kaplan–Meier rather than an ordinary sample median. A median is estimable only if the fitted survival curve falls to 0.5 or below during follow-up; restricted mean survival time may better match some clinical questions.
- Financial Analysis: Return distributions are examined for asymmetry, heavy tails, and other departures from normal models. Skewness and kurtosis can summarize some of those features, but risk decisions also require horizon-specific tail probabilities, quantiles, and loss measures [14].
- Marketing Analytics: Purchase amounts, time on site, and conversion rates can have quite different distributions. Analysts should inspect each metric rather than assume a common shape; when purchase amounts are strongly right-skewed, median and upper quantiles can complement the mean.
- Climate Science: Temperature distributions are described using centers, spreads, and tail measures across stated locations, seasons, and reference periods. A trend in the mean can indicate a location shift. Changes in exceedance rates above fixed, reference-period thresholds address whether defined extremes have become more common, while changes in tail quantiles address whether their magnitudes have shifted. Variance alone cannot establish either conclusion [15].
These examples lead to several practical guidelines for working with descriptive statistics effectively.
Best Practices
Use visualization alongside summary statistics, iterating between them as the analysis develops. Histograms can expose multimodality, box plots can flag potential outliers, and scatter plots can reveal gaps and relationships. Anscombe's quartet demonstrates that datasets can share the same means, variances, correlation, and fitted regression line while having visibly different structures [16].
Report uncertainty alongside inferential point estimates when possible. A sample mean is more informative about a population mean when accompanied by a standard error or confidence interval; a standard deviation instead describes variation among observations [17]. For small samples, acknowledge that estimates can change substantially with additional data.
Document your choices about handling missing values and outliers. Different approaches, such as excluding missing data, imputing values, or trimming extremes, can produce substantially different summaries. Transparency about these decisions allows others to evaluate and reproduce your analysis.
Common Pitfalls
Choose the target estimand before combining percentages or ratios. If the goal is the pooled item-level return rate and one store has a 10% rate on 1,000 items while another has a 20% rate on 100 items, denominator weighting gives , not 15%. An equal-store average answers a different question and may be appropriate when stores, rather than items, are the units of interest.
Standard deviation retains its mathematical meaning as the square root of variance, but a symmetric “mean ± one standard deviation” interpretation can mislead for strongly skewed data. The interval is neither a general coverage guarantee nor a bound on possible values. For nonnegative, right-skewed quantities such as many income measures, report the median and selected quantiles to show asymmetry and coverage; the IQR adds a resistant summary of central spread.
Beware of Simpson's paradox, where an association in aggregated data reverses or disappears after stratification by a third variable [18]. The grouping variable is not automatically a causal confounder; that interpretation needs a causal argument [19]. Computing summaries at relevant levels of aggregation helps reveal such reversals.