HumanEval › Quiz

Michael BrenndoerferMarch 2, 20261 min read
Language AI HandbookAll chapters
Part 54 of 67Benchmark Evaluation
Chapter 418HumanEval › Quiz
Reading section 15 of 15 · Quiz · 1 minSection 15 of 15 · 1 min

Book contents

Section 15 of 15 · 1 min read

HumanEval › QuizOne section · Sections in this chapter15 / 15 ↓
Reading tools Definitions & inline links

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

Ready to test your understanding? Take this quick quiz to reinforce what you've learned about HumanEval and the pass@k metric.

HumanEval and Code Generation Evaluation

Question 1 of 70 of 7 completed
Why is BLEU score problematic for evaluating code generation?