IBM Watson on Jeopardy! (2011) › The Challenge of Jeopardy!
History of Language AIAll chapters IBM Watson on Jeopardy! (2011) › The Challenge of Jeopardy!One section · Sections in this chapter2 / 12 ↓
Reading tools Definitions & inline links
Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.
Article links
Make inline references clickable
Jeopardy! posed an open-domain retrieval and ranking problem rather than a query over one structured database. Its categories ranged from history and literature to science, popular culture, and wordplay.
Jeopardy! clues often use puns, cultural references, indirect wording, and grammatical cues about the expected answer. For example, a clue might read: "This 1980s TV show featured an intelligent car named KITT." A system must classify the answer type as a television show, connect KITT to Knight Rider, and respond in the required question form.
The complexity goes deeper than surface-level pattern matching. Consider a clue like: "This author's 1850 novel featuring Captain Ahab was originally titled 'The Whale'." The system must identify that "1850 novel featuring Captain Ahab" refers to Moby-Dick, recognize that Herman Melville is the author, understand that the original title was indeed "The Whale," and format the response correctly. Multiple layers of inference are required, and the answer isn't explicitly stated in the clue.
Jeopardy! questions also test cultural knowledge and common sense reasoning. A clue might reference a famous quote, a historical event, a literary character, or a pop culture phenomenon, expecting contestants to connect these references to the correct answer. The system must understand context, recognize allusions, and make connections that aren't explicitly stated. This level of language understanding and reasoning was far beyond what any previous AI system had demonstrated.
The time pressure added another dimension of difficulty. Contestants have only a few seconds to process the question after it's read, decide whether they know the answer, and buzz in quickly enough to be the first responder. Watson needed to operate in real-time, processing natural language questions, searching through vast knowledge sources, generating candidate answers, evaluating confidence levels, and deciding whether to buzz in, all within seconds.