SHRDLU (1968) › The Limits of Understanding

SHRDLU's limitations proved as instructive as its successes. Its constraints exposed problems that would occupy artificial intelligence and natural language processing researchers for decades.

The most severe limitation was what researchers called domain brittleness. SHRDLU's understanding was entirely dependent on its blocks world. The system couldn't generalize beyond this narrow domain. If you wanted to add a new type of object, say a sphere or a cylinder, you couldn't simply tell SHRDLU about it. Instead, you had to modify the system's core knowledge representation, update its reasoning procedures, and potentially revise its grammar rules. Extending the system to handle a different domain entirely, such as a kitchen environment or a toolbox, would require rebuilding most of it from scratch. SHRDLU's knowledge was hand-coded and domain-specific, not learned or transferable.

This brittleness stemmed from a deeper problem: the knowledge acquisition bottleneck. Every piece of knowledge SHRDLU possessed had to be explicitly programmed by a human expert. The system knew that blocks could be stacked because Winograd had written code to represent that fact. It knew what "taller than" meant because that comparison had been explicitly defined. As researchers tried to expand such systems to handle richer, more realistic domains, they discovered that the amount of knowledge required grew exponentially. Each new sentence pattern demanded new grammar rules. Each new concept required new representations and reasoning procedures. The complexity quickly became unmanageable.

SHRDLU also confronted what philosophers and AI researchers called the frame problem. This is the challenge of determining which aspects of a situation are relevant when reasoning about actions and their consequences. In the simple blocks world, when you pick up a block, most things stay the same: other blocks don't move, colors don't change, the table remains where it is. But specifying all the things that don't change is surprisingly difficult, especially as domains become more complex. In richer environments, the frame problem makes complete symbolic representation intractable.

Related to this was the symbol grounding problem, a question that became central to cognitive science and AI: how do linguistic symbols connect to real-world meaning? SHRDLU's symbols were grounded in its simulated world, but that world was itself a set of symbols. The system manipulated representations of blocks, not actual blocks. It never confronted the challenge of connecting language to raw sensory data, images, or physical interactions. This left open whether its "understanding" amounted to anything beyond sophisticated symbol manipulation.