Attribution and Citation: Sourcing LLM Outputs › Types of Attribution

Not all attribution looks the same. There are several distinct forms, each with different granularity, form, and use case. Understanding these distinctions is important because the right form of attribution depends on the application, the available retrieval infrastructure, and the level of transparency you need to provide to your users.

Inline citation is the most direct form of attribution. A claim appears in the model's output, and immediately alongside or after it, a reference to the supporting source is provided. This mirrors the convention in academic writing, where a sentence like "Transformers outperform RNNs on most NLP benchmarks (Vaswani et al., 2017)" carries its evidence right with it.

In the context of retrieval-augmented generation, inline citation typically takes the form of numbered references linked to retrieved document passages. A system might produce:

"The Mars Science Laboratory Curiosity rover landed on August 6, 2012 [1]. It has since traveled more than 28 kilometers across Gale Crater [2]."

Here, [1] and [2] point to specific passages from source documents. The model's task is to produce a correct sentence and ensure that [1] contains a passage that supports the landing date, and that [2] contains a passage about distance traveled.

Inline citation is demanding because it requires the model to track provenance at the claim level. A single paragraph might contain five distinct factual claims, each requiring its own source. This is substantially harder than simply retrieving a document and summarizing it. The model must simultaneously attend to the content it is generating, the retrieved context it is drawing from, and the mapping between the two. When this tracking breaks down, the model may produce citations that point to the right document but the wrong passage, or cite a topically related passage that does not contain the specific information claimed.

One important nuance is that inline citation requires a deliberate training signal. A model that has not been exposed to examples of attributed generation during fine-tuning will rarely produce inline citations spontaneously, even if the retrieved passages are clearly numbered in the context. Models like Perplexity AI and various RAG-augmented systems that produce reliable inline citations have been fine-tuned on large collections of cited responses, often with human-annotated citation chains.

Some systems separate generation from attribution. The model first produces a response, then a separate component attempts to find supporting evidence for each claim in the response. This is sometimes called post-hoc attribution because the sourcing happens after generation rather than during it.

Post-hoc attribution is easier to implement because it decouples the generation and retrieval problems. A standard language model can produce its normal output, and then a retrieval system searches a corpus for passages that match each claim. The passages found become the citations, and the system presents them alongside the original response.

However, this approach introduces a structural risk: if the model generates a claim for which no support exists, the post-hoc search either returns incorrect sources (hallucinated attribution) or fails to find any source (leaving the claim unsupported). In either case, the generation step has already produced potentially wrong content, and post-hoc attribution is trying to patch a problem that began at generation time.

This failure mode is qualitatively different from generation-integrated attribution. When attribution happens during generation, the model is constrained to produce claims that its current context supports. When attribution is retrofitted, there is no such constraint, and the mismatch between what was generated and what evidence exists becomes apparent only after the fact. Some post-hoc systems handle this by flagging unsupported claims rather than forcing a citation, which at least makes the gap visible to the user. This flagging behavior is useful: it turns unsupported claims from invisible failures into explicit warnings, allowing the user to investigate further.

Post-hoc attribution is also sensitive to the quality of the claim decomposition step. Before searching for supporting evidence, the system needs to identify the claims in the response. This is itself a non-trivial natural language understanding problem. A sentence like "The Transformer architecture, introduced in 2017, revolutionized NLP by replacing recurrent networks with self-attention" contains multiple claims, each of which needs independent verification. Automated claim decomposition can miss some claims, merge distinct claims, or identify boundaries incorrectly, introducing noise into the downstream attribution search.

At the coarser end of the spectrum, document-level attribution connects an entire response to one or more source documents, without specifying which parts of the response come from which document. This is common in summarization systems, where a model might produce a multi-sentence summary and attribute it to a provided article.

Document-level attribution is less informative than inline citation but is easier to evaluate and implement. It answers "did the model use this document?" rather than "which specific claim comes from which specific passage?" For many applications, this level of granularity is sufficient. If you are summarizing a single known document, document-level attribution simply confirms that the summary is derived from the intended source. If you are comparing multiple documents, it tells you which documents contributed to the response.

The limitation becomes apparent in multi-document settings. If a response draws on ten retrieved documents and only three of them contributed relevant information, document-level attribution that lists all ten gives the reader a misleading picture of what the response is based on. More importantly, if the response contains an error, document-level attribution cannot tell you which source the error came from, making debugging and correction much harder.

Span-level attribution is the most fine-grained form. Each span of generated text, whether a phrase, sentence, or clause, is individually linked to the specific passage in the source that supports it. This provides the most informative attribution signal, but it is also the most technically challenging to produce and evaluate.

Research systems like ALCE (Attributed LM Comprehension Evaluation) have formalized span-level attribution evaluation, making it possible to assess whether a model provides citations and whether each cited passage supports the corresponding claim. ALCE treats attribution as a property of individual sentences, asking: for each sentence in the generated response, is there at least one cited passage that entails that sentence?

In practice, span-level attribution requires the model to reason simultaneously about what to say and which piece of its provided context licenses that statement. This is a form of grounded generation that pushes against language models' natural tendency toward fluent synthesis. Models trained with supervised fine-tuning on attributed corpora, where human annotators have linked each sentence to its source, can learn this behavior. But it requires careful data collection and substantial annotation effort to produce the training signal.

The annotation effort is particularly challenging because span-level attribution ground truth is ambiguous in many cases. A sentence may be supported by multiple passages simultaneously. A claim may be partially supported by one passage and partially by another. Human annotators asked to identify the single best supporting passage for each sentence will disagree at rates that are high enough to make inter-annotator agreement a serious concern. These ambiguities flow through to evaluation: a model that identifies a valid supporting passage that differs from the annotator's preferred passage should not be penalized, but simplistic exact-match evaluation would penalize it.