Bias Mitigation: Debiasing, CDA, and Fair Fine-tuning › Limitations and Practical Considerations

Bias mitigation is difficult, and the field has not solved it. Several limitations apply across all the techniques we have covered.

The definition problem. Every mitigation technique requires defining what "fair" means in your context. Should "doctor" be equally associated with men and women in your embeddings? In a fictional historical corpus, that association might be historically accurate. In a modern clinical application, it might cause harm. The choice of fairness criterion is a values decision, not a technical one. Rushing past it to implement a debiasing algorithm before the definition is settled is the most common mistake in applied fairness work. Different fairness criteria are also mathematically incompatible with each other in the general case, a result known as the impossibility of fairness. Demographic parity, equalized odds, and calibration cannot all be satisfied simultaneously except in degenerate distributions. Choosing a criterion means choosing which tradeoffs are acceptable, and that choice belongs with the product and policy teams, not only with the engineers.

The leakage problem. Removing explicit demographic signals does not remove all demographic information. Models can infer demographic attributes from correlated signals: writing style, vocabulary, location references, and many other proxies. CDA swaps pronouns and names, but a model that has learned to associate formal academic language with one demographic will continue to do so. Thorough debiasing requires identifying all correlated proxies, which is an open research problem. Membership inference attacks and probing classifiers are the standard tools for auditing whether demographic information leaks through a supposedly debiased representation.

The tradeoff problem. Every fairness intervention trades something for something else. Hard debiasing reduces stereotypical associations but can degrade performance on tasks that legitimately depend on gendered context. Counterfactual fine-tuning reduces demographic sensitivity but may reduce accuracy on inputs where demographic context is informative. There is no free lunch: fairness has a cost, and you must decide consciously what you are willing to trade and for whom. The tradeoff is not always between fairness and accuracy. Sometimes the tradeoff is between fairness for group A and fairness for group B. A mitigation that reduces disparity along the gender axis may increase disparity along the age axis if the two correlate in the training data. Monitoring all relevant demographic dimensions simultaneously is essential, rather than monitoring only the one optimized.

The intersectionality problem. Most mitigation techniques address one demographic dimension at a time. A model debiased for gender may still exhibit race-based bias. Worse, debiasing along one dimension can introduce or amplify bias along another because the demographic signals are correlated in the training data. An approach that achieves gender parity by relying more heavily on race as a proxy has not improved equity; it has merely shifted the harm. The Crenshaw framework of intersectionality, which recognizes that individuals occupy multiple demographic categories simultaneously and that these categories interact in non-additive ways, has no fully satisfying technical implementation yet. A Black woman is not simply "Black" plus "woman"; she may face patterns of discrimination that neither axis alone predicts. Evaluating bias for intersectional subgroups requires much larger test sets than single-axis evaluation and is an active area of research.

The evaluation gap. Mitigation techniques are evaluated on benchmark datasets and predefined demographic categories. Real-world harm manifests along dimensions that benchmarks do not capture, for users whose identities do not fit the binary categories assumed by most tools. Most debiasing research uses binary gender categories, which excludes non-binary and gender-nonconforming individuals entirely. The Representation Harms chapter examines some of these gaps in depth.

The temporal drift problem. Even a thoroughly debiased model deployed today will face distribution shift as language evolves, as new demographic groups gain visibility in public discourse, and as the model's outputs begin to influence the text that future models train on. A model trained on 2020 text and deployed in 2027 will encounter conversations that include demographic terminology, cultural references, and fairness norms that did not exist in its training data. Bias mitigation is not a one-time certification; it requires ongoing monitoring and periodic retraining cycles.

Despite these limitations, mitigation is not futile. Thoughtfully applied, the techniques in this chapter substantially reduce the most egregious demographic disparities in model behavior. The key is to treat mitigation as an iterative process: measure, intervene, re-measure, and remain honest about what you have and have not fixed. Pretending that applying CDA and running a WEAT evaluation constitutes a complete fairness solution is more dangerous than acknowledging the remaining gaps, because it closes the feedback loop prematurely.