Quantile Regression › Advantages

The first advantage is a direct description of different parts of the conditional distribution without choosing a complete distributional family. A mean alone does not determine spread or shape, even for symmetric, light-tailed distributions. Fitting levels such as $\tau = 0.05, 0.25, 0.5, 0.75, 0.95$ estimates several conditional cutoffs; the gaps between them describe spread. The linear functional form remains an assumption at each level. Heteroscedasticity can therefore become a feature we estimate rather than something hidden by a single-width summary.

The second advantage is robustness in the response direction. Because the pinball loss grows linearly rather than quadratically, its response score is bounded at fixed predictors, unlike the least-squares score. This does not bound every finite-sample coefficient change; a sample tail quantile can still be determined by one extreme response. At the median, quantile regression is least absolute deviations regression, a maximum likelihood estimate for the regression coefficients under independent Laplace errors centered at zero with a common fixed positive scale, which we first met in maximum likelihood estimation. At a fixed predictor vector, the estimating score is bounded as the response varies; extreme predictors can still have high leverage. For the pinball loss the residual slopes are $\tau$ on the positive side and $\tau - 1$ on the negative side, with magnitudes $\tau$ and $1 - \tau$ respectively, so no slope ever exceeds $1$ in magnitude.

A useful population property is equivariance under continuous strictly increasing transformations. For such a function $h$, quantiles obey $Q_{h(Y)}(\tau)=h(Q_Y(\tau))$; log and exponential transformations on their respective domains satisfy this condition. If the conditional quantile of $\log Y$ is modeled correctly, exponentiating its estimate targets the corresponding quantile of positive $Y$, without a conditional-mean retransformation correction. This does not say that two restricted linear fits, one on $Y$ and one on $\log Y$, agree exactly after transformation in a finite sample.

Finally, quantile regression is a natural tool for asymmetric decision problems. Inventory levels, staffing, safety margins, and service-level agreements can involve quantile targets when their costs or probability constraints have the appropriate form. A blood-pressure reference chart that flags the top 5 percent of children by age is a quantile curve, not a mean curve. When underage and overage costs are positive and linear in the size of the error, expected pinball loss at the cost-implied $\tau$ matches that decision problem up to a positive scale factor.