Weight Decay › Quiz

Michael BrenndoerferJanuary 27, 20261 min read
Language AI HandbookAll chapters
Part 32 of 67Training Optimization
Chapter 235Weight Decay › Quiz
Reading section 11 of 11 · Quiz · 1 minSection 11 of 11 · 1 min

Book contents

Language AI Handbook67 parts · 513 chaptersView the whole book →
Active chapter 235 of 513

Section 11 of 11 · 1 min read

Weight Decay › QuizOne section · Sections in this chapter11 / 11 ↓
Sections in this chapter11
Reading tools Definitions & inline links

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

Ready to test your understanding? Take this quick quiz to reinforce what you've learned about weight decay and AdamW.

Weight Decay Quiz

Question 1 of 80 of 8 completed
What does the weight decay update rule (1−ηλ)θi−ηgi(1 - \eta\lambda)\theta_i - \eta g_i mean in practice?