Setting Goals and Success Criteria › Documenting Your Criteria

Once you've defined success criteria, write them down. This might seem obvious, but it's easy to let criteria remain implicit. That leads to confusion and inconsistency.

Create a simple document that lists:

1. Capability: What the agent should do
2. Success criterion: How you'll measure success
3. Threshold: The target value
4. Priority: How important this is relative to other criteria

Here's a simple format:

CAPABILITY: Answer factual questions
SUCCESS CRITERION: Percentage of correct answers on test set
THRESHOLD: ≥90%
PRIORITY: High

CAPABILITY: Schedule calendar events
SUCCESS CRITERION: Percentage of events correctly scheduled (right date, time, description)
THRESHOLD: ≥95%
PRIORITY: High

CAPABILITY: Respond to simple queries quickly
SUCCESS CRITERION: Percentage of responses under 3 seconds
THRESHOLD: ≥90%
PRIORITY: Medium

Share this document with your team. When you make changes to the agent, refer back to these criteria to ensure you're improving what matters.