WordNet (1995) › Challenges and Limitations

Despite its widespread adoption and influence, WordNet's limitations became increasingly apparent as researchers applied it to diverse problems and as the field of natural language processing evolved. These limitations didn't diminish WordNet's achievements but did highlight challenges inherent in manually constructing large-scale semantic resources and point toward future research directions.

Coverage limitations posed persistent challenges. WordNet 1.0 focused primarily on English, and while subsequent versions expanded coverage and inspired similar projects in other languages, the vast majority of the world's languages remained without comparable resources. Even for English, coverage proved incomplete. Technical terminology, slang, neologisms, domain-specific jargon, and proper names often lacked entries. The language continually evolves, with new words entering the lexicon and existing words acquiring new senses, but WordNet couldn't keep pace. This coverage gap meant that systems relying on WordNet encountered unknown words or senses that they couldn't process semantically.

The manually curated nature of WordNet created both strengths and weaknesses. Manual curation ensured high quality. Expert linguists carefully defined synsets and relationships, producing a resource with relatively few errors. However, this manual process severely limited scalability and adaptability. Creating WordNet required years of intensive labor by skilled lexicographers. Extending coverage meant proportionally more labor. Updating entries to reflect language change happened slowly. New senses, new words, and shifting usage patterns took years to incorporate. In a rapidly evolving information environment where new concepts and terminology emerge constantly, this slow update cycle proved increasingly problematic.

Cultural and linguistic bias affected WordNet's content in subtle but important ways. The linguistic intuitions and world knowledge of its creators shaped what concepts appeared and how they organized. Concepts central to certain cultures might be peripheral or absent in WordNet, while concepts familiar to its American creators received detailed treatment. The relationships encoded reflected particular perspectives on how concepts relate. Different cultures organize taxonomies differently, emphasize different semantic relationships, and draw category boundaries in different places. WordNet encoded one culturally situated view of semantic organization, which might not transfer perfectly to other linguistic communities or cultural contexts.

The discrete nature of relationships in WordNet created challenges for tasks requiring fine-grained similarity judgments. In WordNet, two concepts either share a relationship or they don't. "Car" and "truck" are both hyponyms of "vehicle," making them siblings in the taxonomy, but WordNet provides no direct way to say that cars and trucks are more similar to each other than cars and bicycles, despite bicycles also being vehicles. Path-based similarity measures address this somewhat by considering the distance between concepts, but these measures still produce discrete similarity values determined by graph structure rather than continuous degrees of similarity that might better reflect human judgments.

Granularity problems arose because some synsets grouped concepts too broadly while others drew distinctions too finely. Determining the right level of granularity for synsets involves difficult judgments. Should "automobile" and "car" belong to the same synset, or do subtle differences in usage justify separate synsets? Should different breeds of dogs constitute separate synsets, or should they merge under broader dog synsets? WordNet's creators made thousands of such decisions, and while generally sound, these choices didn't always align with the granularity needs of specific applications. Some applications needed finer distinctions than WordNet provided, while others needed broader groupings.

The lack of semantic compositionality represented another limitation. WordNet treated synsets as atomic units, providing no mechanisms for understanding how meaning composes from parts. The phrase "red car" combines "red" and "car" into a composite concept, but WordNet offered no systematic way to compute the meaning of this combination from its components. Multi-word expressions, idioms, and compounds received separate entries when included, but the systematic relationships between compositional and non-compositional meaning remained underspecified. This limitation mattered increasingly as research focused on understanding phrases, sentences, and documents rather than just individual words.