Normalization › Mathematical Foundation
Machine Learning from ScratchAll chapters Normalization › Mathematical FoundationOne section · Sections in this chapter3 / 10 ↓
Reading tools Definitions & inline links
Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.
Article links
Make inline references clickable
The Min-Max Normalization Formula
For a feature with observations, min-max normalization transforms each value to using:
where:
- is the normalized value of feature for observation
- is the minimum value of feature
- is the maximum value of feature
Key Properties
After normalization, each feature in your dataset is transformed so that it has a minimum value of 0 and a maximum value of 1. This transformation ensures that all features, regardless of their original range or units, are directly comparable and contribute equally to the analysis. In practical terms, this means that no single feature will dominate the learning process simply because it has a larger numeric range. Instead, every feature is scaled to the same [0, 1] interval, allowing algorithms.especially those sensitive to feature magnitude, such as neural networks or distance-based methods.to perform optimally and fairly.
- Minimum: for all features
- Maximum: for all features
- Range: for all features
This ensures that all features contribute equally to distance calculations and optimization processes.