Morphology and Word Formation › Other Word Formation Processes

Affixation and compounding cover most cases, but languages innovate through several additional mechanisms that show up constantly in real text. Each one stresses a different assumption that classical text-processing pipelines quietly make, so it pays to know them individually.

Cliticization attaches a bound element that behaves syntactically like a word. English possessive 's is the classic case: in the queen of England's crown, 's attaches to England even though it marks possession by the queen. Contractions like we're and they've blend clitics with the tokenization questions from Part I: is we're one token, two, or a word plus a clitic? Clitics occupy an awkward middle ground between morphology and syntax, and different toolkits answer the tokenization question differently, which silently changes your corpus statistics.

Conversion (zero derivation) changes a word's part of speech without changing its form. Google became a verb; a run came from the verb run. Conversion is invisible to string-level processing, which is why part-of-speech taggers from Part VI must rely on context rather than word shape. It is also increasingly common in modern text as brands, products, and technologies get verbed (to email, to zoom, to dm), so any lexicon-based tagger ages quickly.

Blending fuses fragments of words: smog (smoke + fog), brunch, motel. Acronymy builds words from initials: NATO, laser, FOMO. Both are common sources of out-of-vocabulary tokens in modern text, and both are essentially unpredictable in advance: nobody could have enumerated FOMO before the culture that produced it existed.

Back-formation removes a perceived affix: edit was extracted from editor, burgle from burglar. Back-formation is historically fascinating because it runs morphology backwards: speakers assume a longer word is derived and invent the shorter "original." Reduplication repeats all or part of a word for emphasis or plurality, and is grammatically central in Indonesian, Tagalog, and many other languages. For those languages reduplication is not a curiosity but a load-bearing grammatical mechanism, and pipelines that ignore it lose real information.

Finally, root-and-pattern (templatic) morphology interleaves vowels into consonantal roots. Semitic languages like Arabic and Hebrew store roots as bare consonant skeletons: Arabic k-t-b carries the notion of writing, and vowel patterns derive kataba (he wrote), kitāb (book), kuttāb (writers), maktab (office). The root's consonants are interleaved with vowels and almost never appear as one contiguous substring, which breaks character n-gram heuristics and makes templatic languages a standing challenge for subword tokenizers, as we discussed in the Tokenization Challenges chapter of Part V. Where European-style morphology lets a tokenizer find the root by trimming edges, templatic morphology hides it in the middle of the word, interleaved with unrelated vowels, and no amount of edge-trimming recovers it.