Search and Belief-Space Planning › Key Parameters

Michael BrenndoerferJuly 9, 20261 min read
World Models HandbookAll chapters
Part 7 of 12Planning and Agency
Chapter 39Search and Belief-Space Planning › Key Parameters
Reading section 6 of 13 · Key Parameters · 1 minSection 6 of 13 · 1 min

Book contents

Section 6 of 13 · 1 min read

Search and Belief-Space Planning › Key ParametersOne section · Sections in this chapter6 / 13 ↓
Reading tools Definitions & inline links

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

The key parameters for POMCP in this chapter are:

  • n_sims: Number of simulations per plan. Determines how much of the belief tree is explored.
  • c: UCB1 exploration coefficient over actions at a history node.
  • max_depth: Maximum simulated horizon from the root history.
  • rollout policy: Default policy used to evaluate newly reached history nodes; here, a guided BFS shortcut over the sampled state.
  • root belief representation and n_sims: The root belief supplies the state-sampling distribution, while n_sims determines how many root-state draws feed one search. More simulations can cover the belief more thoroughly, but repeated draws need not produce that many distinct particles.