Active Perception, Dual Control, and Exploration › Key Parameters

Michael BrenndoerferJuly 11, 20261 min read
World Models HandbookAll chapters
Part 7 of 12Planning and Agency
Chapter 41Active Perception, Dual Control, and Exploration › Key Parameters
Reading section 7 of 10 · Key Parameters · 1 minSection 7 of 10 · 1 min

Book contents

Section 7 of 10 · 1 min read

Active Perception, Dual Control, and Exploration › Key ParametersOne section · Sections in this chapter7 / 10 ↓
Reading tools Definitions & inline links

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

The key parameters for the gridworld exploration example are:

  • INSPECT_ACC: The probability that inspecting reveals the true target label. For this symmetric channel, values farther above chance, from 0.50.5 toward 1.01.0, make inspection more informative and generally reduce the number of probes needed.
  • INSPECT_COST: The reward cost charged for each observation. It determines when the one-probe task value exceeds immediate commitment.
  • beta: The additional reward-per-nat weight on raw information. In this example small values leave the decision-aware policy unchanged, while large values cause avoidable extra probes.
  • threshold: The information-gain cutoff used by the curious policy. Lower thresholds cause inspection on weaker evidence.
  • HAZARD: The known forbidden cell used by the one-step action filter. It is not a learned or probabilistic hazard model.