IBM Watson on Jeopardy! (2011) › Performance and Real-Time Processing

Watson had to analyze each clue and produce a response within the show's timing constraints. Its parallel architecture generated and evaluated candidates within seconds.

The parallel processing architecture was essential for achieving this speed. While a single processor would have taken minutes or hours to process a single question, thousands of processors working simultaneously could generate and evaluate hundreds of candidate answers within seconds. Different processors could work on different aspects of the problem simultaneously: parsing the question, retrieving relevant information, generating candidate answers, and scoring confidence.

Jeopardy! awards the response opportunity to the first contestant who successfully signals after the clue is read. Watson therefore needed both a candidate and a calibrated confidence score before deciding to buzz.

However, speed alone wasn't sufficient. The system also needed to balance speed and accuracy, recognizing when it had sufficient confidence to buzz in and when it should wait. The confidence scoring mechanisms helped Watson avoid buzzing in with low-confidence answers, improving its overall accuracy by only attempting answers when it had high confidence.