Hallucination Types in Language Models: A Complete Guide › Intrinsic vs Extrinsic Hallucination
Language AI HandbookAll chapters Hallucination Types in Language Models: A Complete Guide › Intrinsic vs Extrinsic HallucinationOne section · Sections in this chapter3 / 15 ↓
Reading tools Definitions & inline links
Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.
Article links
Make inline references clickable
The foundational distinction in hallucination research separates hallucinations based on their relationship to a provided source document. This taxonomy, widely used in summarization and question-answering research, asks a single question: does the generated content contradict the source, or does it go beyond it?
Intrinsic Hallucination
Intrinsic hallucination occurs when generated text directly contradicts information in the provided source. The model changes, inverts, or misrepresents facts that are explicitly stated in the input.
An intrinsic hallucination is a generated statement that directly contradicts information present in the source document. The hallucination is detectable by comparing the output to the input, without any external knowledge.
Consider a news article that states: "The company reported revenue of $4.2 billion, a 12% increase from the prior year." An intrinsic hallucination in a summary might read: "The company reported revenue of $4.2 billion, down 12% from the prior year." The contradiction is detectable purely from the source text: the direction of change was flipped.
Intrinsic hallucinations are particularly problematic because they can be identified without external knowledge. A model that contradicts its own input has failed at the most basic task of faithfulness. They commonly appear in:
- Summarization: Flipping numerical values, changing who did what, altering the direction of changes (increase vs decrease, positive vs negative)
- Translation: Changing named entities or quantities in a way not supported by the source
- Document question-answering: Answering a question with information that contradicts the passage
- RAG-based systems: Generating claims that conflict with retrieved context
The mechanics behind intrinsic hallucinations often involve what researchers call "copy failure." The model has seen the source text, understands the general structure of the claim it needs to make, but fails to faithfully copy the specific values or directions from the source. Instead, it generates the most statistically likely value for that slot, which may differ from what the source says. A model that sees "revenue... 12%... compared to prior year" may correctly identify these as the relevant elements but incorrectly fill in the direction of change if "down" is marginally more likely in its training distribution than "up" for sentences with similar structure.
The detectability of intrinsic hallucinations makes them a natural target for automated faithfulness evaluation. If you have the source document, you can check whether the output entails or contradicts it. Natural language inference (NLI) models are well-suited for this task, and we will build on this idea in the code section.
Extrinsic Hallucination
Extrinsic hallucination occurs when generated text introduces information that is neither present in nor inferable from the source document. Unlike intrinsic hallucination, the new information does not necessarily contradict the source. It simply goes beyond it.
An extrinsic hallucination is generated content that adds information not found in the source document. The added information cannot be verified from the source alone. Extrinsic hallucinations are sometimes factually true (the added detail happens to be correct) but are still problematic because they are ungrounded in the provided evidence.
Using the same example, an extrinsic hallucination might read: "The company reported revenue of $4.2 billion, a 12% increase from the prior year. CEO Jane Smith attributed the growth to expanding markets in Southeast Asia." If the source article does not mention Jane Smith or Southeast Asia, this is an extrinsic hallucination even if the facts happen to be true.
This is a subtle but important point. Extrinsic hallucinations are not always factually wrong. A model with relevant world knowledge might add accurate details. But in tasks where faithfulness to a source matters (summarization, RAG-based QA, document analysis), adding ungrounded information undermines trust in the system. The user reading the summary cannot distinguish information from the document from information the model added from elsewhere. This inability to distinguish grounded claims from ungrounded ones is the core problem: even when the extrinsic content is accurate, it poisons the reader's ability to know what the document said.
The frequency of extrinsic hallucinations often increases as source documents become longer or more complex. When a model is asked to summarize a document that does not clearly address a particular aspect of a topic, it may fill the gap with plausible-sounding claims from its parametric knowledge rather than acknowledging the gap or restricting itself to what the document says. This "completion instinct" is a natural consequence of training on next-token prediction: the model is always trying to produce a coherent, complete-seeming continuation, even when the honest answer is that the source doesn't cover the topic.
Why This Distinction Matters
The intrinsic/extrinsic distinction has direct implications for how you detect and mitigate hallucinations.
Intrinsic hallucination detection can rely solely on the source and output. If the output contradicts the source, it is intrinsically hallucinated. This makes it amenable to automated NLI-based evaluation: decompose both source and output into sentences, run each pair through an NLI classifier, and flag any output sentences that receive high contradiction scores. The approach is fast, automated, and requires no external resources beyond the NLI model.
Extrinsic hallucination detection requires external knowledge to verify the added content. Did the model add true information from world knowledge, or did it fabricate something? This is a harder problem. You need either access to an external fact base, a retrieval system that can verify claims, or a second model capable of distinguishing "plausible claim about this entity" from "verified claim about this entity." This is precisely the direction that hallucination detection research has moved toward, and we will examine these approaches in the Hallucination Detection chapter.
For closed-book tasks (no source document provided), this taxonomy does not apply directly, since there is no source to compare against. Instead, you evaluate against ground truth knowledge, which leads to the broader category of factual errors.