Setting Goals and Success Criteria › Iterating on Success Criteria

Michael BrenndoerferJuly 31, 20251 min read
AI Agent HandbookAll chapters
Part 11 of 15Evaluation - Measuring Your Agent's Performance
Chapter 30Setting Goals and Success Criteria › Iterating on Success Criteria
Reading section 10 of 13 · Iterating on Success Criteria · 1 minSection 10 of 13 · 1 min

Book contents

Section 10 of 13 · 1 min read

Setting Goals and Success Criteria › Iterating on Success CriteriaOne section · Sections in this chapter10 / 13 ↓

Your success criteria aren't set in stone. As you learn more about how users interact with your agent, you'll refine them.

You might discover that some criteria were too strict or too lenient. You might find that you forgot important dimensions. You might realize that a criterion you thought mattered doesn't affect user satisfaction.

That's fine. Treat your success criteria as a living document. After each round of testing or each deployment cycle, revisit them:

  • Are these criteria still relevant?
  • Are the thresholds appropriate?
  • Are we missing important dimensions of success?
  • Have our priorities changed?

The goal isn't perfection on the first try. The goal is to have clear, shared criteria that evolve as your understanding deepens.