Computation and understanding › What the person inside the room knows
PhilosophyAll chapters Reading tools Notes & comments
Computation and understanding › What the person inside the room knowsSection view · Sections in this chapter1 / 10 ↓
Imagine that you are locked in a room. Through a narrow slot in the wall, someone pushes in slips of paper covered in Chinese characters. You don't read Chinese, not a single character. But stacked beside you is a thick rulebook, written in English, that tells you exactly which Chinese characters to write down and push back out, depending on which characters came in. You become very good at this. The people outside the room grow convinced they are corresponding with a fluent Chinese speaker. They ask questions, you return answers, and the answers are indistinguishable from those a native speaker would give.
Now the question: do you understand Chinese?
The obvious answer is no. You understand the rulebook. You understand that this squiggle should be followed by that squiggle. But the meanings of the symbols, what they refer to and what they are about, never enter your mind. You are manipulating shapes, not grasping content.
John Searle introduced this thought experiment in his 1980 paper “Minds, Brains, and Programs.” Its target is strong AI, as he defined it. Strong AI says that running the right program is enough for the computer to understand and that the program explains the corresponding human ability. Searle argues that the person in the room can carry out all of the formal steps required by the program and still fail to understand a word of Chinese. His conclusion concerns what implementing a program alone can accomplish. A machine with the relevant causal powers could think, he says. Searle, pp. 417–418 and 422–424.
If you were outside the room, you would have a good reason to guess that you were corresponding with someone who understood you. From the inside, you know exactly how you came to write each answer and what was absent from that process. The argument asks us to take both perspectives seriously. It also raises a question the story itself leaves open. Does what the person knows settle what the whole system understands?
Comments
Add to the conversation
A question, a correction, or an example from your own work.
No comments yet. Be the first to share your thoughts!