Differential Evolution › Advantages

Michael BrenndoerferOctober 29, 20261 min read
Machine Learning from ScratchAll chapters
Part 15 of 15Heuristic and Evolutionary Optimization
Chapter 92Differential Evolution › Advantages
Reading section 2 of 10 · Advantages · 1 minSection 2 of 10 · 1 min

Section 2 of 10 · 1 min read

Differential Evolution › AdvantagesSection view · Sections in this chapter2 / 10 ↓
Reading tools Definitions, links & notes

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Article links

Make inline references clickable

Notes & comments

DE obtains its perturbation scale from population differences rather than requiring a separate fixed standard deviation for every decision variable. The factor FF, crossover rate CRCR, population size, initialization, and bounds still require choices. We will test some of those choices instead of assuming that a single setting works for every objective.

DE only needs objective values for proposed real-valued vectors, so its evolutionary phase does not require derivatives. This is useful for simulation outputs or discontinuous losses. A population can retain candidates in several regions at once, although it need not cover every basin and can lose that diversity.

In a deferred generation, every trial is formed from the same old population. Independent objective evaluations can then be batched or distributed before selection. The primitive implementation below evaluates trials serially so that each candidate has an explicit budget index. At a generation boundary, the population, its objective values, and the archived best retain the candidate history used by the next sweep. Reproducing that sweep also requires the objective, bounds, operator settings, remaining budget, and RNG state.

Comments

Add to the conversation

A question, a correction, or an example from your own work.

No comments yet. Be the first to share your thoughts!

Newsletter

Stay up to date

Get new articles, book updates, and notes on AI and technology.

Unsubscribe at any time. Privacy policy