WordNet (1995) › Applications in Natural Language Processing

Michael BrenndoerferMarch 3, 20254 min read
History of Language AIAll chapters
Part 2 of 9The Statistical Turn
Chapter 25WordNet (1995) › Applications in Natural Language Processing
Reading section 5 of 11 · Applications in Natural Language Processing · 4 minSection 5 of 11 · 4 min

Book contents

Section 5 of 11 · 4 min read

WordNet (1995) › Applications in Natural Language ProcessingOne section · Sections in this chapter5 / 11 ↓
Reading tools Definitions & inline links

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

WordNet's release in 1995 provided NLP researchers with a resource they had long sought: a large-scale, computationally accessible database of semantic knowledge. This resource supported new approaches to longstanding problems across language processing. Its applications show how structured lexical knowledge changed the field's methods.

Word sense disambiguation emerged as one of WordNet's most important applications. Many words carry multiple meanings, and determining which sense a particular occurrence intends represents a fundamental challenge in language understanding. Consider the word "bank." Does it refer to a financial institution or the edge of a river? In isolation, the word provides no clue. Context must resolve the ambiguity. WordNet supported sense disambiguation by providing structured information about each sense and its relationships to other concepts. A system encountering "bank" in the phrase "opened a bank account" could use WordNet to recognize that "account" relates to the financial institution sense but not to the river edge sense, helping select the correct interpretation. More sophisticated approaches computed semantic similarity between the words surrounding "bank" and the concepts in WordNet related to each sense, selecting the sense with the strongest contextual support.

Information retrieval systems use WordNet to expand queries with semantically related terms, addressing the vocabulary mismatch problem where queries and relevant documents use different words for the same concepts. A user searching for "automobile" might miss relevant documents that use "car" or "vehicle" instead. By consulting WordNet, the retrieval system can recognize these terms as related concepts and expand the query to include synonyms and near-synonyms. More sophisticated expansions might include hypernyms and hyponyms, allowing a query about vehicles to retrieve documents discussing cars, trucks, or buses. This query expansion improves recall without requiring users to anticipate all possible phrasings, making search systems less sensitive to vocabulary variation.

Text classification benefits from WordNet by enabling systems to recognize semantic similarities between documents that use different vocabulary. Two documents might discuss related topics using quite different terms. One document might mention "automobiles," "sedans," and "vehicles," while another discusses "cars," "transportation," and "driving." By consulting WordNet, a classification system can recognize that these documents share semantic content despite using different words. Features based on WordNet concepts rather than individual words can improve classification accuracy by reducing the impact of vocabulary differences and capturing semantic similarity more directly.

Machine translation systems use WordNet to resolve translation ambiguities. Many words translate differently depending on their sense. The English word "bank" translates to different words in other languages depending on whether it means a financial institution or a river edge. WordNet helps identify which sense applies in a given context, enabling the system to select the appropriate translation. Additionally, WordNet's hierarchical structure helps select translation terms at appropriate levels of generality, avoiding overly specific or overly generic translations.

Question answering systems use WordNet to identify semantic relationships between questions and potential answers. If a question asks "What vehicles appeared in the movie?" and a passage mentions "cars and trucks," WordNet helps the system recognize that cars and trucks are types of vehicles, making the passage relevant to the question. This semantic matching capability, grounded in WordNet's hierarchical structure, allows question answering systems to find answers even when the question and answer use different vocabulary.

Semantic similarity measurement represents another application. Many NLP tasks require computing how semantically related two words or concepts are. WordNet enables several approaches to this problem. Path-based measures compute similarity based on the distance between concepts in the hierarchy: concepts separated by fewer links are more similar than concepts separated by many links. Information-content-based measures weight these paths by how specific the concepts are, recognizing that similarity between very specific concepts counts for more than similarity between very general ones. These similarity measures support numerous applications, from paraphrase detection to semantic text similarity assessment.