Prompt Tuning › Prompt Tuning

In the previous chapter, we explored prefix tuning, which prepends trainable continuous vectors to the keys and values at every layer of a transformer. While effective, this approach has drawbacks: soft prefixes must be maintained across all attention layers, and the reparameterization MLP used during training adds additional overhead. This raises a practical question: Can we reach similar parameter efficiency with an even simpler approach, one that does not require modifying the internal computations of the model at all?

Prompt tuning, introduced by Lester et al. in 2021, answers this question decisively. Instead of modifying every layer of the transformer, prompt tuning prepends trainable "soft prompt" embeddings only at the input layer. The frozen model processes these soft prompts alongside the actual input tokens through all its layers, completely unchanged. This radical simplification reduces the number of trainable parameters from thousands per layer down to a single matrix, creating a remarkable finding: as model scale increases, prompt tuning closes the gap with full fine-tuning and eventually matches its performance at sufficient scale.

Think of prompt tuning as giving the model a special preamble in its own native language. When you fully fine-tune a model, you are in effect rewriting chapters of its internal encyclopedia to focus on your task. With discrete text prompts, you write a cover letter in English that says "please classify sentiment." Prompt tuning sits between these extremes: you learn an abstract preamble in the model's continuous embedding language, a wordless instruction that the model reads before processing your actual input. The model itself never changes, but the context it receives is optimized specifically for your task.

To appreciate why this matters, consider the practical challenges of deploying fine-tuned models at scale. A company serving thousands of distinct customer use cases would need to store thousands of complete model copies if using full fine-tuning. Each copy of GPT-3 at 175 billion parameters would require roughly 700 gigabytes of storage. With prompt tuning, you store a single frozen model and thousands of tiny prompt matrices, each perhaps 200 kilobytes. The entire library of task-specific adaptations fits in the space of a single model copy.

This chapter examines the prompt tuning formulation, how initialization strategies affect performance and training dynamics, its scaling behavior, how prompt length interacts with context-window constraints, and a complete implementation. These dynamics explain why prompt tuning became a foundational technique in parameter-efficient adaptation and sparked substantial follow-on research into how large models encode and retrieve task knowledge.