Hallucination Mitigation: RAG, Decoding, and Training › Limitations and Impact

Hallucination mitigation is not a solved problem, and each mitigation strategy carries its own limitations.

Retrieval augmentation depends critically on retrieval quality. A well-constructed knowledge base with a strong retrieval model and careful context formatting is the single largest lever available to practitioners. But building and maintaining that knowledge base requires ongoing engineering investment. For open-domain factual questions, the knowledge base cannot cover every relevant fact; for recent events, it requires continuous updating. RAG also shifts the failure mode rather than eliminating it: instead of model hallucination, you get retrieval failure and context-ignoring errors, which may be harder to detect. A system that confidently returns a retrieved passage that is outdated or incorrect has simply substituted one type of factual error for another.

Self-consistency decoding assumes that incorrect answers are more variable than correct ones. This is true on average but not always. A model that is consistently wrong (a systematic error learned from biased training data) will show high consistency but low accuracy. Self-consistency is most effective for tail-end hallucinations where the model is uncertain; it does not help with confident systematic errors. If a model was trained on a large corpus that consistently misrepresents some fact, self-consistency will amplify that error rather than catching it.

Training-based approaches require data. High-quality preference datasets pairing hallucinated and truthful responses are expensive to construct and may not cover the distribution of queries in production. DPO and RLHF improve behavior on the in-distribution queries they were trained on; out-of-distribution queries remain risky. Models trained with strong anti-hallucination objectives may also develop excessive refusal behavior, being unhelpful on queries where they have sufficient knowledge to answer correctly. The tension between reducing hallucination and maintaining helpfulness is a fundamental design challenge in RLHF and DPO training.

Uncertainty expression is only valuable if it is calibrated: if the model says "I'm not sure" on every answer, it provides no useful signal. Calibrated uncertainty requires both training signal and rigorous evaluation on held-out data. Measuring calibration requires ground truth at scale, which is costly to collect. Most deployed models are overconfident: they express high certainty on claims that turn out to be false more often than a well-calibrated model would.

Post-hoc verification adds a latency cost and introduces its own error sources. An NLI model used for consistency checking has its own failure modes; an LLM used as a verifier can hallucinate corrections. Every layer added to a mitigation pipeline is an additional source of latency, cost, and potential failure. The engineering tradeoff between mitigation thoroughness and deployment practicality is real and depends on the stakes of the application.

Despite these limitations, the impact of combining these techniques in production has been substantial. Modern deployed LLMs that combine retrieval, self-consistency, RLHF-based anti-hallucination training, and uncertainty expression are measurably more reliable than base models. Benchmarks like TruthfulQA, FELM, and FActScore show consistent improvements when mitigation techniques are applied. The most impactful deployments use retrieval augmentation as the primary lever (addressing the knowledge gap problem directly) and uncertainty expression as the user-facing communication layer (replacing confident hallucinations with honest admissions of uncertainty).

The research frontier has moved toward more intrinsic solutions: training objectives that directly optimize for factuality rather than relying on the indirect signal of human preferences, calibration-aware training that teaches the model to model its own uncertainty, and interpretability tools that identify factual versus confabulated content in the model's internal representations. We will explore calibration in more depth in the upcoming chapter on Uncertainty Quantification.