Attribution and Citation: Sourcing LLM Outputs › Source Verification

Attribution tells you where a claim came from. Source verification asks a harder question: is the source itself reliable? This distinction matters because a language model can produce a well-attributed statement based on a low-quality or factually incorrect source.

Imagine a RAG system that retrieves from a large web corpus without quality filtering. The model produces a claim like "according to [1], the optimal daily protein intake is 400 grams per kilogram of body weight." The citation is correct: passage [1] does say this. The attribution evaluation will give this a perfect score. But passage [1] is from a fitness blog with no scientific backing, and the claim is wrong by more than an order of magnitude. The attribution layer has done its job; the source verification layer has not.

Source verification goes beyond what language models themselves can easily accomplish. It typically requires integration with external systems:

• Domain authority checks: Does the cited source come from a recognized, authoritative domain? A medical claim cited from a peer-reviewed journal is different from the same claim cited from a blog. Systems can encode these authority hierarchies, assigning higher trust scores to citations from curated sources.
• Publication date checks: Is the cited source current? In rapidly evolving fields, a citation from five years ago may have been superseded by more recent research. A source from 2018 about transformer architectures will lack significant developments introduced in subsequent years.
• Cross-reference verification: Does the claim appear in multiple independent sources? Triangulation across sources reduces the risk that a single incorrect source is misleading the model. If five independent papers all report the same finding, the probability that the finding is correct is much higher than if only one source says it.
• Structured knowledge base lookup: Can the claim be verified against a structured knowledge base like Wikidata or a medical ontology? Structured knowledge is generally more reliable than free-text documents because it is curated and validated. Wikidata claims are linked to external sources and undergo community review; they carry a different epistemic status than a passage from an arbitrary web document.

In practice, RAG systems often use curated document corpora with known quality properties. A production system might restrict retrieval to documents from a trusted set of publishers, journals, or databases, giving a degree of implicit source verification at the corpus level. This architectural choice, essentially treating corpus quality as a proxy for source quality, is simpler than runtime source verification but offers weaker guarantees: even trusted sources contain errors, and outdated information from trusted sources is still outdated.

The interaction between attribution and source verification creates a two-layer trust model. The first layer asks "does the model's output match the sources it cites?" The second layer asks "are the sources the model cites trustworthy?" Only systems that pass both layers can be said to provide reliable attributed outputs. Most current attribution evaluation frameworks operate at the first layer and leave source verification as an architectural concern.