Setting Goals and Success Criteria › Iterating on Success Criteria
Michael BrenndoerferJuly 31, 20251 min read
AI Agent HandbookAll chapters Part 11 of 15Evaluation - Measuring Your Agent's Performance
Setting Goals and Success Criteria › Iterating on Success CriteriaOne section · Sections in this chapter10 / 13 ↓
Sections in this chapter13
Your success criteria aren't set in stone. As you learn more about how users interact with your agent, you'll refine them.
You might discover that some criteria were too strict or too lenient. You might find that you forgot important dimensions. You might realize that a criterion you thought mattered doesn't affect user satisfaction.
That's fine. Treat your success criteria as a living document. After each round of testing or each deployment cycle, revisit them:
- Are these criteria still relevant?
- Are the thresholds appropriate?
- Are we missing important dimensions of success?
- Have our priorities changed?
The goal isn't perfection on the first try. The goal is to have clear, shared criteria that evolve as your understanding deepens.