Code Understanding › Code Understanding

Every large software project contains functions written months ago whose original authors have moved on, bug reports tied to stack traces that span dozens of files, and pull requests where reviewers must quickly assess whether a subtle refactor introduces regressions. For decades, these tasks fell entirely to human expertise. The emergence of code-aware language models has changed that equation: models can now explain what code does, flag potential defects, review patches for style and correctness, and retrieve relevant implementations from large repositories.

Code understanding covers everything a language model does with source code as input when the goal is analysis rather than generation. The distinction matters. Generating code requires the model to produce something new; understanding code requires the model to produce a faithful interpretation of something that already exists. This is a harder test in some ways, because the model's output can be verified against ground truth: a bug is real or it is not, an explanation matches the code or it does not.

The four capabilities covered in this chapter are grounded in a shared technical substrate but address different phases of the software development lifecycle. Explanation supports onboarding and maintenance: when a developer joins a project or returns to code they have not touched in months, understanding what existing code does is the first bottleneck. Bug detection supports quality assurance: catching defects before they reach production is cheaper than fixing them after, and a model that flags likely errors before a commit saves engineering time at scale. Code review supports collaboration: it automates the first pass of the review process, freeing human reviewers to focus on the higher-order concerns that require judgment. Code search supports discovery: finding the right function in a large codebase is a prerequisite for using it, and semantic search makes that discovery practical without requiring the developer to know the exact vocabulary used by the original author.

This chapter covers four core capabilities: code explanation, bug detection, code review, and code search. These are not independent; all four rest on the same foundation of code representations and semantic understanding. We will examine how models build that understanding, how each capability works mechanically, how they are implemented in practice, and where each one currently falls short.