PropBank (2005) › Applications and Impact

PropBank's 2005 release supplied both a role-labeling scheme and annotated training data for statistical systems. Within a few years, the CoNLL shared tasks were using PropBank data to evaluate semantic role labeling systems.

The most direct application of PropBank was semantic role labeling (SRL), the task of automatically identifying which phrases in a sentence fill which semantic roles. PropBank provided both a framework for specifying roles and substantial annotated training data, making SRL a practical task for statistical NLP systems. Early SRL systems trained on PropBank data could learn patterns like: when "give" appears as the main verb, the subject typically fills Arg0 (the giver), the direct object typically fills Arg1 (what is given), and a prepositional phrase with "to" typically fills Arg2 (the recipient).

These patterns enabled systems to label semantic roles in new text automatically. The CoNLL-2004 and CoNLL-2005 shared tasks used PropBank data, giving researchers shared training sets, test sets, and evaluation procedures for SRL.

Modern semantic role labeling systems, including neural approaches, continue to use PropBank annotations as training data. SRL remains useful for applications that represent event structure, including information extraction, question answering, and text summarization.

Information extraction systems benefited substantially from PropBank's structured semantic annotations. Traditional information extraction focused on identifying entities and binary relations, but struggled with events that involved multiple participants with specific roles. PropBank provided a framework for representing these events systematically, enabling systems to extract structured information about who did what to whom, where, when, and why.

Consider extracting information from news articles about corporate events. A sentence like "Acme Corp acquired TechStart Inc for $50 million in 2005" requires identifying the acquirer (Acme Corp), the target (TechStart Inc), the price ($50 million), and the date (2005). PropBank's annotations enable systems to recognize that "acquired" is the predicate, with the subject as Arg0 (the acquirer), the object as Arg1 (the target), and prepositional phrases providing additional roles. Systems trained on PropBank data could learn these patterns and apply them to extract structured information from unstructured text automatically.

PropBank's compatibility with syntactic trees also let extraction systems combine syntax and semantics. Syntactic information identified argument boundaries, while role labels described what each argument represented. This combination could outperform systems that used only one annotation layer.

Question answering systems used PropBank to represent what a question asks and where its answer might appear. In "Who gave the book to Mary?", the requested answer is Arg0 of a "give" event whose Arg1 is "the book" and Arg2 is "Mary." A system can search for a matching event and return the phrase that fills Arg0.

Structured roles also helped with questions involving several participants. "Who sold what to whom for how much?" requests multiple roles in a "sell" event. A system can represent those roles and match them against similarly structured passages instead of relying on keyword overlap alone.

Machine translation systems, particularly statistical machine translation systems, used PropBank to preserve semantic roles across languages. Translation systems need to ensure that when they translate a sentence, the semantic relationships between participants remain consistent. If a source sentence has "John gave Mary a book," where John is Arg0 (the giver), Mary is Arg2 (the recipient), and the book is Arg1 (what is given), the translation should preserve these roles even if the target language expresses them differently syntactically.

PropBank provided a language-independent representation of these roles. Translation systems could map source language sentences to PropBank-style semantic structures, then generate target language sentences from those structures. This ensured that roles were preserved even when syntax differed. This approach was particularly useful for translation between languages with different syntactic structures, where direct word alignment might lose semantic information. Systems that preserved semantic roles produced more accurate translations, especially for sentences involving complex event structures.

PropBank's compatibility with the Penn Treebank supported research that combined syntactic and semantic analysis. Researchers could study how semantic roles were realized in argument alternations, voice constructions, and control structures. The shared annotation made both types of information available to the same models and analyses.

PropBank also influenced other semantic annotation projects. OntoNotes incorporated PropBank-style roles alongside layers for syntax, semantics, and discourse. These combined annotation layers supported analyses that crossed levels of linguistic structure.