Volume 1 of 3 · PDF edition

Volume 1: Signals, Symbols, and Statistical Methods

From Shannon and Turing through symbolic systems, speech recognition, statistical machine translation, recurrent networks, and the statistical turn.

The complete book remains free to read online. This paid edition is the carefully typeset PDF you keep, with every future update included.

Pages
324 pages
Chapters
31 chapters
Price
$14 one-time
Buy nowLearn more
History of Language AI, Volume One: Signals, Symbols, and Statistical Methods cover

Author and edition details

About the author and Volume 1 PDF edition

Michael Brenndoerfer, author of History of Language AI

Michael Brenndoerfer

Michael has spent more than a decade working across software engineering, data, AI, and business. He writes to understand difficult ideas more deeply and to share what he learns in a clear, practical way.

Report an error or suggest a correction
Edition
Volume 1 PDF 2026.08.2
Published
Last reviewed

Historical through-line

What this volume explains

  • Explain how information theory, formal linguistics, and symbolic programs framed the earliest language-AI problems.
  • Trace the shift from hand-written rules to corpora, probability, and trainable statistical systems.
  • Connect hidden Markov models, backpropagation, recurrent networks, and benchmarks to later language-model development.

Audience and prerequisites

Who this volume is for

Readers who want the foundations and historical context behind modern natural-language processing.

Prerequisites: This volume starts at the beginning and assumes no prior history of NLP or machine learning.

Free online preview

Start with “Shannon's N-gram Model (1948)”

Claude Shannon's foundational work on information theory that introduced n-gram models, laying the groundwork for statistical language processing

Read the chapter

Exact contents

31 chapters across 2 parts

Signals & Symbols

  1. 01Shannon's N-gram Model (1948)
  2. 02The Turing Test (1950)
  3. 03Georgetown-IBM Machine Translation Demo (1954)
  4. 04The Perceptron (1957)
  5. 05Chomsky's Syntactic Structures (1957)
  6. 06MADALINE Neural Networks (1962)
  7. 07ELIZA (1966)
  8. 08Viterbi Algorithm (1967)
  9. 09SHRDLU (1968)
  10. 10Vector Space Model & TF-IDF (1968)
  11. 11Conceptual Dependency Theory (1969)
  12. 12The Transition to Statistical Methods (1970s)
  13. 13Hidden Markov Models (1970s)
  14. 14Augmented Transition Networks (1970)
  15. 15Montague Semantics (1973)
  16. 16Chinese Room Argument (1980)

The Statistical Turn

  1. 01Lesk Algorithm (1983)
  2. 02Backpropagation (1986)
  3. 03Katz Back-off (1987)
  4. 04Time Delay Neural Networks (1987)
  5. 05Convolutional Neural Networks (1988)
  6. 06IBM Statistical Machine Translation (1991)
  7. 07Penn Treebank (1993)
  8. 08BM25 (1994)
  9. 09WordNet (1995)
  10. 10Recurrent Neural Networks (1995)
  11. 11Maximum Entropy & SVMs in NLP (1996)
  12. 12Long Short-Term Memory (1997)
  13. 13Statistical Parsers (1997)
  14. 14FrameNet (1998)
  15. 15LSA & Topic Models (1999)

Volume 1 PDF

Own this 324-page edition

Get the PDF and every future update and erratum for this volume. Your purchase is fully credited toward the complete edition.

  • Carefully typeset PDF
  • Future updates and errata included
  • Portable offline reading
  • Delivered by email and added to My books

Volume 1 of 3

$14

one-time

Version 2026.08.2 · 324 pages · secure checkout via Stripe

Delivered by email · Free updates included

Compare editions

This volume or the complete book?

Volume 1: Signals, Symbols, and Statistical Methods

324 pages focused on Signals & Symbols and The Statistical Turn.

$14

The complete History of Language AI

All three volumes in one 968-page PDF. Three distinct volume purchases unlock it automatically; two volumes leave a $6 complete-edition upgrade.

$34

Compare all PDF editions

Also in the series

Explore the other volumes

Volume 2 · 319 pages

Neural Networks, Attention, and Transformers

Structured Learning & Benchmarks · Deep Learning Arrives · Transformers & Pretraining

Explore Volume 2

Volume 3 · 338 pages

Scaling, Alignment, and Agentic AI

Scaling & Retrieval · Multimodal & Instruction Era · Open Models & Alignment · Agents & Long Context

Explore Volume 3

Version history

Kept current, not frozen in time

Each PDF purchase includes future editions. When the book changes, the updated copy appears in My books at no extra cost.

Current release

Edition 2026.08.2

Editorial improvements.

Earlier releases2

  1. 2026.08.1

    Editorial improvements throughout the book, with clearer explanations, refined presentation, and improved plots and visualizations.

  2. 2026.08.0

    Initial complete-book and three-volume PDF release with perpetual updates.