Markov and Partially Observable Decision Processes › Key Parameters for the T-Maze
Michael BrenndoerferJune 7, 20261 min read
World Models HandbookAll chapters Part 2 of 12Inference, Decisions, and Control
Markov and Partially Observable Decision Processes › Key Parameters for the T-MazeOne section · Sections in this chapter11 / 14 ↓
Sections in this chapter14
Reading tools Definitions & inline links
Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.
Article links
Make inline references clickable
The key parameters for the T-maze experiment are:
- CUE_ACCURACY: Probability, set to 0.9, that the starting cue identifies the rewarded arm correctly.
- STEP_COST: Cost per action, set to 0.1, incurred both at the junction advance and upon entering an arm.
- ARM_REWARD: Reward magnitude, set to 4.0, paid for entering the correct arm and penalized for entering the wrong arm.
- seed: Random generator seed 7 controls environment sampling; seed 8 controls the random agent's independent action stream. Both keep the experiment reproducible without repeating the same first draw in every episode.
- n_episodes: Number of evaluation episodes, set to 4000, which tightens the empirical estimates against the analytical predictions.