Summarization › Worked Example: From Extraction to Abstraction

Michael BrenndoerferJanuary 19, 20263 min read
Language AI HandbookAll chapters
Part 63 of 67LLM Applications
Chapter 479Summarization › Worked Example: From Extraction to Abstraction
Reading section 4 of 10 · Worked Example: From Extraction to Abstraction · 3 minSection 4 of 10 · 3 min

Book contents

Section 4 of 10 · 3 min read

Summarization › Worked Example: From Extraction to AbstractionOne section · Sections in this chapter4 / 10 ↓
Reading tools Definitions & inline links

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

To make these approaches concrete, let us trace through a simple example. Consider this short passage:

"The Amazon rainforest covers 5.5 million square kilometers across nine countries. It produces 20% of the world's oxygen and houses 10% of all species on Earth. Deforestation has accelerated in recent decades, driven by agricultural expansion and logging. Scientists warn that losing 20-25% of the Amazon could trigger a 'dieback' event where the forest can no longer sustain itself."

An extractive summarizer might score each sentence and select the top two. Using a simple word frequency approach (after removing stopwords), the most distinctive terms are "Amazon," "rainforest," "deforestation," "species," "oxygen," and "dieback." Sentence 1 scores highly for "Amazon" and "rainforest." Sentence 4 scores highly for "Amazon," "forest," and introduces "dieback" (a term that appears nowhere else, making it locally distinctive). A good extractive summary might be:

"The Amazon rainforest covers 5.5 million square kilometers across nine countries. Scientists warn that losing 20-25% of the Amazon could trigger a 'dieback' event where the forest can no longer sustain itself."

An abstractive summarizer, in contrast, might generate:

"The Amazon rainforest, covering 5.5 million km² and hosting 10% of Earth's species, faces accelerating deforestation that could trigger catastrophic ecosystem collapse."

The abstractive summary is more concise, combines facts from multiple sentences (the size and the species statistic), and uses "catastrophic ecosystem collapse" to rephrase the scientific concept of "dieback" in more accessible language. It also omits the oxygen statistic, making an editorial judgment that the species diversity and dieback risk are more relevant to a general reader.

This comparison reveals both the power and the danger of abstractive summarization. The power: the abstractive summary is more informative, more informative per word than the extractive version. The danger: the abstractive model could just as easily generate "the Amazon rainforest hosts 10% of Earth's species and is growing rapidly" by confusing deforestation with growth, or "scientists warn of a 30% threshold" by misremembering the 20-25% figure. Extractive systems cannot hallucinate because they copy from the source; abstractive systems can generate anything that looks plausible given the source context.

Notice also what the extractive summary loses: the oxygen production statistic from sentence 2 does not appear. The extractive system had no way to combine it with the species statistic into a single more informative sentence. Each sentence had to stand alone. This illustrates why abstractive summarization can produce shorter, denser summaries that pack more information per word, but only when the model correctly understands and faithfully represents all the source facts it chose to include.