Reasoning Frontiers › Reasoning Frontiers

Language models have long been evaluated on what they know. But the questions driving research today are about what they can figure out given time to think. This shift, from knowledge retrieval to extended deliberation, marks one of the most significant inflection points in the field since the transformer architecture itself. The emergence of reasoning-capable models like OpenAI's o1 and o3, DeepSeek-R1, and Google's Gemini Thinking series has fundamentally changed how practitioners think about compute, capability, and evaluation.

For most of the transformer era, the dominant assumption was that model quality was determined almost entirely at training time. You assembled a dataset, trained a large model, and then deployed it cheaply and quickly. The inference pass was an afterthought, a cheap lookup into a compressed representation of everything the model had learned. Chain-of-thought prompting, covered in earlier chapters, hinted that this assumption might be wrong, that a model producing intermediate steps could do better than a model answering directly. But chain-of-thought was still conceptually a prompt engineering trick: you were nudging an existing model to reveal capabilities it already had. What changed with o1 is that the model itself was trained to reason, with extended deliberation becoming a first-class behavior rather than an elicited artifact.

This chapter maps current research. We cover the architecture of o1-style reasoning, the theory and practice of test-time compute scaling, the range of current reasoning-capable models, and the open research questions that remain unanswered. If the previous chapters on chain-of-thought prompting, verification strategies, and reasoning limitations gave you the foundations, this chapter shows where those foundations lead.