Model Merging Applications › Summary

Model merging applications span four main domains: multi-task merging, style merging, capability composition, and evaluation.

Multi-task merging combines independently fine-tuned models into a single generalist without requiring access to task data or re-training. The task arithmetic formula $\theta_{\text{merged}} = \theta_{\text{base}} + \sum_t \lambda_t \tau_t$ is the core operation, with TIES and DARE variants reducing interference from conflicting task vectors. Before merging, computing pairwise cosine similarities between task vectors provides an early signal about which merges are likely to succeed. Optimal $\lambda$ values typically fall between 0.3 and 0.8, and a task loss below 5% (meaning the merged model performs at 95% of the dedicated fine-tune's level) is generally considered acceptable.

Style merging applies merging to blend behavioral and stylistic characteristics rather than task competencies. Layer-wise merging assigns different blend coefficients to different transformer depths, weighting later layers more heavily because high-level stylistic information concentrates there. SLERP offers a geometrically principled interpolation that preserves vector norms, avoiding the scale reduction that standard linear interpolation introduces at intermediate blend values and that can produce flat-feeling outputs.

Capability composition assembles models with novel abilities by combining specializations that occupy partially orthogonal parameter space. Success depends on whether the target capabilities are complementary (using different parameters) or competing (modifying the same parameters in conflicting directions). Frankenmerging extends capability composition to physical layer assembly, exploiting the shared representational scaffold that pre-training creates across all models initialized from the same base. Evolutionary search automates the configuration search by maintaining a population of candidate configurations and applying mutation and crossover operators.

Merging evaluation requires broad benchmark coverage, normalized performance scores that express merged model quality relative to both base and fine-tuned ceilings, and Pareto analysis to understand the tradeoff surface between tasks. A normalized score of 1.0 means the merge perfectly preserved the fine-tune's benefit, while 0.0 means full regression to base performance. Fast proxies including perplexity on task-specific held-out data and calibration quality enable efficient configuration search before running expensive full evaluations, enabling a staged workflow that reduces total evaluation compute by an order of magnitude.