Computation and understanding › The Argument, Step by Step

Michael BrenndoerferUpdated June 9, 20263 min read
PhilosophyAll chapters
Reading tools Notes & comments
Notes & comments
Part 7 of 12Mind, Self, and Experience
Chapter 84Computation and understanding › The Argument, Step by Step
Reading section 5 of 10 · The Argument, Step by Step · 3 minSection 5 of 10 · 3 min

Section 5 of 10 · 3 min read

Computation and understanding › The Argument, Step by StepSection view · Sections in this chapter5 / 10 ↓

Searle builds the contrast inside the room. In the original paper, the person receives material in both Chinese and English. The English stories are ones the operator can read and answer questions about. The Chinese story and questions are ones the operator treats as marks to compare with other marks. Both exchanges can look fluent to people outside. Placing the two in one room asks readers to explain what is present in the English case and missing in the Chinese one. Searle, pp. 417–418.

First, imagine that the instructions are good enough to produce responses that fluent Chinese readers accept in the story task. This is a stipulation, not a result about the performance of the original research program. The argument requires that the operator miss no steps even when the instructions exploit details of the story and earlier questions. A mistake in the responses would give the people outside an ordinary reason to doubt the operator’s proficiency and distract from Searle’s point.

Now put a person inside the machine, executing its program by hand. You, an English speaker with no knowledge of Chinese, sit in the room with the rulebook. The rulebook contains precisely the instructions the computer would follow. You receive the Chinese input, consult the rules, and produce the Chinese output. You carry out every formal operation the program requires.

Note that you still don't understand Chinese. You have no idea what any of the characters mean. You can't tell a question about the weather from a question about mathematics except by the shapes of the symbols. If anyone understands Chinese, it isn't you.

Searle draws a wider conclusion from the case. If running a program were enough to understand those stories, then understanding ought to be present in the room once the program is successfully carried out. He judges that the arrangements provide nothing beyond the operator’s ability to apply rules to characters. On that judgment, the room implements the program but lacks Chinese understanding. Anyone who disputes the larger conclusion can accept what the operator says about their own knowledge while challenging what that tells us about the organized process.

What the room is meant to establish

The person can execute the program without knowing Chinese. Against strong AI, Searle also needs the claim that no other level of organization present in the room supplies the missing understanding. The systems reply targets that move.

Comments

Add to the conversation

A question, a correction, or an example from your own work.

No comments yet. Be the first to share your thoughts!

Newsletter

Stay up to date

Get new articles, book updates, and notes on AI and technology.

Unsubscribe at any time. Privacy policy