Computation and understanding › Why It Matters Now

Michael BrenndoerferUpdated June 9, 20262 min read
PhilosophyAll chapters
Reading tools Notes & comments
Notes & comments
Part 7 of 12Mind, Self, and Experience
Chapter 84Computation and understanding › Why It Matters Now
Reading section 8 of 10 · Why It Matters Now · 2 minSection 8 of 10 · 2 min

Section 8 of 10 · 2 min read

Computation and understanding › Why It Matters NowSection view · Sections in this chapter8 / 10 ↓

Consider a machine that translates a request to move a meeting. If the request is ambiguous about which week is meant, the machine might ask a question, inspect a calendar, or infer the date from earlier messages. The ability to do those things would improve its usefulness and give a person more evidence of its competence. Does that competence amount to understanding? The paper suggests separating whether it gets the date right, whether its process reliably connects words with the relevant events, and what would make that connection an instance of understanding.

Large language models invite the comparison because a person may meet them entirely through language. The comparison needs a premise about the mechanism. Searle’s original operator follows a written rulebook, whereas a trained language model uses learned parameters to compute its outputs. The relevant question for his argument is whether the powers the model exercises are fully accounted for by implementing a formal program, or whether the wider system has causal capacities that could support understanding. Counting similar turns of conversation cannot decide which description is adequate.

It helps to keep understanding apart from sentience. The Chinese Room asks whether the organized process has the intentional content its outputs appear to express. Whether an artificial system feels anything, including pain or distress, asks a further question about experience. A general verdict about what formal programs explain does not settle which artificial systems have which capacities.

Comments

Add to the conversation

A question, a correction, or an example from your own work.

No comments yet. Be the first to share your thoughts!

Newsletter

Stay up to date

Get new articles, book updates, and notes on AI and technology.

Unsubscribe at any time. Privacy policy