Perception and Action › Perception and Action

Michael BrenndoerferJuly 15, 20251 min read
AI Agent HandbookAll chapters
Part 8 of 15Environment and Interaction - The Agent's World
Chapter 22Perception and Action › Perception and Action
Reading section 1 of 10 · Perception and Action · 1 minSection 1 of 10 · 1 min

Book contents

Section 1 of 10 · 1 min read

Perception and Action › Perception and ActionOne section · Sections in this chapter1 / 10 ↓

In the previous section, we defined what an environment is for our AI assistant. Now we'll explore the two fundamental ways our agent interacts with that environment: perception and action. Think of it like this: if the environment is the world our agent lives in, then perception is how it senses what's happening, and action is how it makes things happen.

Just like a self-driving car uses sensors to see the road and then steers or brakes to act, our AI assistant "senses" input and then acts by generating responses or using tools. But here's what makes this interesting: the environment isn't static. The agent's perceptions change its internal state, and its actions change the environment, which in turn creates new things to perceive. It's a continuous loop.

Let's break down how this works in practice.