Conceptual Dependency Theory (1969) › The Problem: Meaning Beyond Syntax

The challenge that motivated Conceptual Dependency appeared whenever natural language systems tried to perform semantic reasoning. Traditional parsing systems produced syntactic structures, trees showing how words grouped into phrases and how phrases combined into sentences. But these structures didn't capture meaning in a way that enabled inference or cross-linguistic equivalence. Consider the sentences "The cat chased the mouse," "The mouse was chased by the cat," and "It was the cat that chased the mouse." All describe the same event, but traditional parsers treated them as completely distinct structures.

The problem became acute when systems tried to answer questions or make inferences. If a system understood "John gave Mary a book," it should be able to answer "What did John give to Mary?" or "Who received a book from John?" without needing to parse these questions and match them against the original sentence's syntax. It should recognize that "Mary received a book from John" means the same thing, even though the grammatical structure is reversed. And it should be able to infer that Mary now has the book, even though this information wasn't explicitly stated.

Early natural language systems attempted various solutions. Some tried to encode meaning directly in syntactic rules, creating grammar rules that included semantic annotations. But this conflated syntax and semantics in ways that made grammars unwieldy and difficult to maintain. Other systems used predicate logic as a meaning representation, translating sentences into logical formulas. But predicate logic was too fine-grained, creating different representations for semantically equivalent sentences that differed only in how information was expressed. The sentence "John killed Mary" might be represented as $kill(john, mary)$ while "Mary was killed by John" became $killed\_by(mary, john)$, obscuring the fact that these expressed the same event.

A deeper problem was inference. To answer questions or understand discourse, systems needed to draw conclusions from what was explicitly stated. If the system knew that "John gave Mary a book," it should infer that Mary now possesses the book, that John no longer has it (unless he had multiple copies), and that the transfer happened in the past. Predicate logic could represent these inferences, but only with extensive axioms about the properties of actions. What was needed was a representation where such inferences emerged naturally from the structure of the representation itself.

The representation also needed to handle paraphrases and translations. Natural language provides many ways to express the same meaning. "John sold Mary a car" and "Mary bought a car from John" describe the same transaction from different perspectives. A useful meaning representation should capture what happened, the transfer of ownership and money, in a way that made these paraphrases obviously equivalent. This required moving beyond surface structure to a deeper, more abstract level of representation.