Transformers and Neural State-Space Architectures › Quiz

Michael BrenndoerferJune 26, 20261 min read
World Models HandbookAll chapters
Part 5 of 12World-Model Architectures
Chapter 26Transformers and Neural State-Space Architectures › Quiz
Reading section 10 of 10 · Quiz · 1 minSection 10 of 10 · 1 min

Book contents

Section 10 of 10 · 1 min read

Transformers and Neural State-Space Architectures › QuizOne section · Sections in this chapter10 / 10 ↓
Reading tools Definitions & inline links

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

Ready to test your understanding? Take this quick quiz to reinforce what you've learned about transformers, neural state-space architectures, and their role in world models.

Transformers and Neural State-Space Architectures

Question 1 of 80 of 8 completed
In scaled dot-product attention, why are the dot products between queries and keys divided by dk?\sqrt{d_k}?