Computation and understanding › Why It Matters Now
PhilosophyAll chapters Reading tools Notes & comments
Computation and understanding › Why It Matters NowSection view · Sections in this chapter8 / 10 ↓
Consider a machine that translates a request to move a meeting. If the request is ambiguous about which week is meant, the machine might ask a question, inspect a calendar, or infer the date from earlier messages. The ability to do those things would improve its usefulness and give a person more evidence of its competence. Does that competence amount to understanding? The paper suggests separating whether it gets the date right, whether its process reliably connects words with the relevant events, and what would make that connection an instance of understanding.
Large language models invite the comparison because a person may meet them entirely through language. The comparison needs a premise about the mechanism. Searle’s original operator follows a written rulebook, whereas a trained language model uses learned parameters to compute its outputs. The relevant question for his argument is whether the powers the model exercises are fully accounted for by implementing a formal program, or whether the wider system has causal capacities that could support understanding. Counting similar turns of conversation cannot decide which description is adequate.
It helps to keep understanding apart from sentience. The Chinese Room asks whether the organized process has the intentional content its outputs appear to express. Whether an artificial system feels anything, including pain or distress, asks a further question about experience. A general verdict about what formal programs explain does not settle which artificial systems have which capacities.
Comments
Add to the conversation
A question, a correction, or an example from your own work.
No comments yet. Be the first to share your thoughts!