IBM Watson on Jeopardy! (2011) › Machine Learning and Training

Watson used supervised learning for question classification, answer extraction, and confidence estimation. Historical Jeopardy! clues and responses supplied training examples for these models.

Question classification models learned to identify what type of question was being asked and what kind of answer was expected. Different question types required different processing strategies, and the classification models helped route questions to the appropriate components. Answer extraction models learned to identify candidate answers within retrieved text passages, recognizing relevant information even when it wasn't explicitly stated in answer format.

Confidence estimation connected answer ranking to game strategy. Watson used the score to decide whether to buzz or abstain, based on patterns learned from historical clues and outcomes.

The system also employed unsupervised learning techniques to discover relationships between concepts and entities in its knowledge base. These techniques helped the system make connections that might not be explicitly stated in the training data, allowing it to answer questions that required linking information from different sources or recognizing indirect relationships between concepts.

Training data from Jeopardy! was particularly valuable because it included correct answers as well as information about difficulty, question structure, and linguistic patterns. The system learned to recognize question types, linguistic constructions, and answer patterns that were common in Jeopardy! questions, improving its ability to handle the show's distinctive style.