Attention Sinks › Quiz
Michael BrenndoerferUpdated July 4, 20251 min read
Language AI HandbookAll chapters Part 18 of 67Long Context
Attention Sinks › QuizOne section · Sections in this chapter16 / 16 ↓
Sections in this chapter16
Reading tools Definitions & inline links
Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.
Article links
Make inline references clickable
Ready to test your understanding? Take this quick quiz to reinforce what you've learned about attention sinks and StreamingLLM.
Attention Sinks Quiz
Question 1 of 80 of 8 completed
What is an attention sink in autoregressive transformers?