Penn Treebank (1993) › The Annotation Scheme

The Penn Treebank's annotation scheme reflected careful compromises between linguistic theory, annotator reliability, and computational utility. Consider the representation of verb phrases, central to English syntax. A sentence like "John quickly ate the sandwich" would be analyzed with "John" as a noun phrase (NP) serving as subject (-SBJ), and "quickly ate the sandwich" as a verb phrase (VP). Within this VP, "quickly" forms an adverb phrase (ADVP), "ate" is the verb, and "the sandwich" is an NP serving as the object. The tree structure captures both the hierarchical constituency.which words group together.and grammatical functions through functional tags.

Coordination received special treatment, given its ubiquity and complexity. Phrases joined by "and," "or," or "but" were annotated with a flat structure: "cats and dogs" would be bracketed as (NP (NP cats) (CC and) (NP dogs)), where CC marks the coordinating conjunction. This representation, while not capturing deeper semantic relationships between conjuncts, proved consistent and sufficient for training statistical models. More complex coordinations, like "old men and women," where "old" might modify just "men" or both conjuncts, required annotators to make judgment calls guided by context and the principle of preferring right-branching structures when ambiguity persisted.

The treebank's treatment of gapping and ellipsis, where material is omitted but understood, demonstrated its practical focus. In "John likes apples and Mary pears," the verb "likes" is elided in the second conjunct. Rather than attempting to represent the missing verb with special empty categories or complex transformational derivations, the treebank used a simple notation: (S (NP Mary) (VP (NP pears))), with the absence of an overt verb marking the ellipsis. This "surface-true" approach prioritized the words present in the text over underlying representations, making annotation faster and more consistent while still enabling statistical models to learn gapping patterns.

Prepositional phrase attachment, a classic source of syntactic ambiguity, was handled through explicit structural choices. In "I saw the man with the telescope," "with the telescope" could attach to "saw" (indicating the instrument used for seeing) or to "the man" (describing which man was seen). The treebank guidelines specified that annotators should use semantic and pragmatic clues to determine the most likely attachment, then represent it structurally. For sentences where attachment remained ambiguous, guidelines specified default preferences. This ensured consistency even when the "right" answer was unclear. This pragmatic approach acknowledged that perfect disambiguation might be impossible while still producing a usable corpus.

The functional tags added a layer of grammatical information beyond pure constituency. A subject NP received the -SBJ tag; temporal modifiers got -TMP; locative modifiers got -LOC. These tags enabled researchers to train models that predicted constituent structure and grammatical roles, approaching semantic role labeling. The tags were somewhat shallow compared to full semantic representations.they didn't specify exactly what semantic role a phrase played, only broad functional categories.but they significantly enriched the corpus's utility.

The annotation scheme also addressed null elements and traces, representing movement and long-distance dependencies. In "Which book did John read?" the word "which book" has logically moved from its underlying position as the object of "read." The treebank represented this with a trace marker: (SBARQ (WHNP (WDT Which) (NN book)) (SQ (VBD did) (NP (NNP John)) (VP (VB read) (NP T)))), where T marks the trace position linked to the moved wh-phrase. Although traces added annotation complexity, they encoded predicate-argument structure and syntactic relationships not visible in the surface word order.