Introduction to Reasoning › Common Pitfalls with Reasoning

Michael BrenndoerferJune 21, 20251 min read
AI Agent HandbookAll chapters
Part 4 of 15Reasoning - Teaching the Agent to Think
Chapter 9Introduction to Reasoning › Common Pitfalls with Reasoning
Reading section 10 of 14 · Common Pitfalls with Reasoning · 1 minSection 10 of 14 · 1 min

Book contents

Section 10 of 14 · 1 min read

Introduction to Reasoning › Common Pitfalls with ReasoningOne section · Sections in this chapter10 / 14 ↓

As you use chain-of-thought prompting, watch out for these issues:

Over-reasoning simple questions: Don't force reasoning onto questions that don't need it. "What's 2 + 2?" doesn't need a multi-step explanation.

Assuming reasoning guarantees correctness: Reasoning helps, but the agent can still make mistakes. The reasoning might be flawed, or based on incorrect assumptions. Always check important results.

Making prompts too long: If you're adding extensive examples or instructions for reasoning, you might make your prompts unwieldy. Keep them as concise as possible while still being clear.

Forgetting to use the reasoning: If you prompt for reasoning but then only look at the final answer, you're missing the value. The reasoning itself is useful for verification and understanding.