Probability Theory Fundamentals for Quantitative Finance

Consequential finance decisions often involve uncertainty. Will the stock price rise or fall tomorrow? What's the likelihood a borrower defaults on their loan? How should we price an option when future volatility is unknown? Probability theory provides the mathematical language to quantify uncertainty and make decisions without pretending the outcome is known.

Probability theory turns vague notions like "likely" or "risky" into model- and data-specific numerical statements. For illustration, an analyst might report a hypothetical bond's estimated one-year default probability as 2.3%, or describe a specified return series and estimation window with 16% annualized volatility. The numbers are meaningful only with that scope; the same language supports portfolio analysis, derivatives pricing, and risk management.

The foundations we cover here, random variables, distributions, expected values, and conditional probabilities, appear throughout quantitative finance. Portfolio theory relies on expected returns and covariances. Option pricing depends on probability distributions of future asset prices. Credit risk models use conditional default probabilities. Many supervised-learning methods minimize an empirical loss as an estimate of expected risk. Master these fundamentals, and you'll have the building blocks for the quantitative techniques that follow.

Before we can assign probabilities, we need a probability space $(\Omega,\mathcal{F},P)$: a sample space $\Omega$, a sigma-algebra $\mathcal{F}$ of measurable events, and a probability measure $P$ on those events. This framework begins with three foundational concepts for discussing randomness.

The sample space is the foundation upon which all probability calculations rest. Think of it as the complete catalog of everything that could possibly happen when we conduct our random experiment. The key word here is "complete." The sample space must include every conceivable outcome, even those that seem unlikely or undesirable. If an outcome is missing from our sample space, we have no mathematical way to discuss its probability.

Consider rolling a six-sided die. The sample space is $\Omega = \{1, 2, 3, 4, 5, 6\}$, listing every possible result. For a stock's daily return, the sample space might be $\Omega = [-1, \infty)$, since returns cannot be less than -100% but can, in principle, be arbitrarily large (though extreme returns are rare). Notice how the nature of the random experiment determines the appropriate sample space: a finite set for the die, an infinite continuum for stock returns. Choosing the right sample space is the first modeling decision we make, and it shapes all subsequent analysis.

Events emerge from our questions about uncertain situations. While the sample space contains raw outcomes, events package those outcomes into meaningful categories that correspond to questions we want to answer. The event "rolling an even number" is the subset $\{2, 4, 6\}$, which collects all the individual outcomes where an even number appears. The event "stock return exceeds 5%" contains every possible return value greater than 0.05. By defining events as subsets, we gain access to the powerful machinery of set theory for combining and manipulating them.

Events can be combined using set operations. If $A$ is "stock rises" and $B$ is "volume is high," then:

• $A \cup B$ is "stock rises OR volume is high (or both)"
• $A \cap B$ is "stock rises AND volume is high"
• $A^c$ is "stock does not rise"

These set operations allow us to build complex events from simpler ones, mirroring how we naturally combine conditions in financial analysis. When a portfolio manager asks "what's the probability that either the market rallies or volatility spikes?" they're implicitly using the union operation. The intersection operation captures joint occurrences, while the complement captures the negation of an event.

With sample spaces and events defined, we need rules for assigning probabilities to events. Andrey Kolmogorov formalized probability theory in 1933 with three standard axioms that any probability measure $P$ must satisfy. They capture basic consistency requirements while leaving room for many different probability measures.

1. Non-negativity: $P(A) \geq 0$ for any event $A$
2. Normalization: $P(\Omega) = 1$ (something must happen)
3. Countable additivity: For mutually exclusive events $A_1, A_2, \ldots$,

The first axiom says probabilities cannot be negative. The second normalizes the scale by assigning $P(\Omega)=1$, while $P(\varnothing)=0$ follows from the axioms. A nontrivial event can still have probability 1 or 0 without being logically certain or impossible; such events occur almost surely or have probability zero. The third axiom says that for mutually exclusive events, the probability of at least one occurring equals the sum of their individual probabilities.

Together with the measurable space and the surrounding mathematics, these axioms define a probability measure and yield the rules used in this chapter. Several useful properties follow immediately:

• Complement rule: $P(A^c) = 1 - P(A)$
• Probability bounds: $0 \leq P(A) \leq 1$
• Addition rule: $P(A \cup B) = P(A) + P(B) - P(A \cap B)$

The complement rule follows from the fact that $A$ and $A^c$ are mutually exclusive and their union is the entire sample space: $P(A) + P(A^c) = P(\Omega) = 1$. The probability bounds follow from the complement rule combined with non-negativity. The addition rule requires subtracting $P(A \cap B)$ to avoid double-counting outcomes that belong to both events.

The addition rule accounts for double-counting when events overlap. If the probability of a stock rising is 0.55 and the probability of high volume is 0.30, we cannot simply add these to find the probability of either occurring; we must subtract the probability of both happening together. This correction is essential whenever we combine events that share common outcomes.

While sample spaces and events provide the conceptual foundation, we typically work with random variables that map outcomes to numbers. This mapping enables mathematical operations like addition, multiplication, and the computation of averages. The transition from abstract outcomes to numerical values makes probability theory quantitative; it lets us apply calculus, linear algebra, and optimization to uncertainty.

The definition of a random variable as a function might initially seem abstract, but it captures a natural idea: we take the raw outcomes of a random experiment and translate them into numbers that we can analyze mathematically. The word "variable" reflects that the numerical value varies depending on which outcome occurs. The word "random" indicates that we don't know in advance which outcome will occur.

When we say "let $X$ be the daily return of a stock," we mean $X$ is a function that, for each possible market scenario $\omega$, produces a number representing that day's return. Before the market closes, $X$ is random because we do not know which $\omega$ will occur. After closing, we observe a specific realization $x = 0.023$ (a 2.3% return). The distinction between $X$ and its realized value $x$ determines which tools apply. Before observation, we work with probabilities and expectations; after observation, we work with data.

A discrete random variable takes values from a countable set, such as integers or a finite list. Discrete random variables arise when outcomes fall into distinct categories or when we count occurrences of events. The probability mass function (PMF) specifies the probability of each possible value, giving us a complete description of how probability is distributed across the possible outcomes.

The PMF answers the most direct question we can ask about a discrete random variable: "What's the probability that $X$ takes this particular value?" By specifying these probabilities for every possible value, the PMF provides complete information about the random variable's behavior. The subscript $X$ in $p_X(x)$ reminds us which random variable we're describing, since different random variables have different PMFs.

Consider a simplified credit rating model where a bond can be in one of three states at year-end:

The probabilities sum to 1 because exactly one outcome must occur: this bond will be upgraded, unchanged, or downgraded. The Kolmogorov axioms require the probabilities of this exhaustive list of mutually exclusive outcomes to sum to 1.

Financial quantities such as returns, prices, and interest rates are often approximated with continuous random variables, even though observed market values may lie on discrete ticks and empirical distributions may contain atoms. A continuous distribution assigns probability zero to each individual point; this property does not require every intermediate real value to belong to its support. When the distribution is absolutely continuous, a probability density function gives interval probabilities by integration.

The PDF represents a fundamentally different concept than the PMF. Rather than giving the probability of exact values (which is zero for continuous variables), the PDF describes how probability is spread across the continuum of possible values. Higher density means probability is more concentrated in that region, while lower density means probability is more dispersed. The integral formula captures this: to find the probability of landing in an interval, we accumulate (integrate) the density across that interval.

The density itself is not a probability; it can exceed 1 for concentrated distributions. Only when we integrate over an interval do we obtain a probability between 0 and 1. Think of density as probability per unit length: a density of 2 at a point does not mean probability 2.

Both discrete and continuous random variables have cumulative distribution functions, giving a unified way to describe probability distributions. The CDF answers the running question "what's the probability of being less than or equal to this value?" as we move along the number line.

The CDF provides a universal framework for discrete and continuous random variables. It is nondecreasing and right-continuous, with limits 0 as $x \to -\infty$ and 1 as $x \to +\infty$. These properties make it useful for computing interval probabilities: $P(a < X \leq b) = F_X(b) - F_X(a)$.

The CDF starts near 0 for very negative values and approaches 1 for large values. If the distribution is absolutely continuous, $F_X(x)=\int_{-\infty}^{x}f_X(u)\,du$ and $f_X=F_X'$ almost everywhere. A continuous CDF need not have a density, so this derivative relationship requires the stronger absolute-continuity condition.

Certain probability distributions appear repeatedly in quantitative finance, and each encodes specific assumptions about how uncertainty manifests. Understanding their properties helps you recognize when to apply each one and interpret model outputs correctly. Choosing the right distribution is a fundamental modeling decision.

The normal (Gaussian) distribution is common in financial modeling because it is tractable and because the Central Limit Theorem gives normal approximations to properly normalized sums under conditions such as independence or sufficiently weak dependence and finite variance. That theorem does not say that returns must be normal merely because trading aggregates many decisions. Normal models can approximate the center of some return distributions, while their tails and dependence often require separate treatment.

A normal random variable $X \sim \mathcal{N}(\mu, \sigma^2)$ has density:

where:

• $f_X(x)$: probability density at value $x$, representing the relative likelihood of observing a value near $x$
• $\mu$: mean (center) of the distribution, where the peak occurs
• $\sigma$: standard deviation (spread), controlling the width of the bell curve
• $\sigma^2$: variance, the square of the standard deviation
• $\exp(\cdot)$: exponential function ($e$ raised to the given power)
• $\pi$: mathematical constant (≈ 3.14159)
• The term $(x - \mu)^2 / (2\sigma^2)=\tfrac{1}{2}z^2$ is one-half the squared standardized distance $z=(x-\mu)/\sigma$
• The normalization factor $1/(\sigma\sqrt{2\pi})$ ensures the total area under the curve equals 1

The formula's structure reveals important intuition: the exponential of a negative quadratic creates the bell shape. Values near the mean make the exponent close to zero, while the exponent's magnitude grows quadratically with standardized distance and drives the density toward zero symmetrically. The density's slope magnitude does not increase forever; it peaks one standard deviation from the mean and then tends back toward zero in the tails.

The parameters are:

• $\mu$: Mean, the center of the distribution. In finance, this represents expected return.
• $\sigma^2$: Variance, measuring spread. Its square root $\sigma$ is the standard deviation, often called volatility.

The standard normal distribution ($\mu = 0$, $\sigma = 1$) is especially important. Any normal variable can be standardized:

where:

• $Z$: standardized random variable (also called z-score)
• $X$: original normal random variable
• $\mu$: mean of $X$
• $\sigma$: standard deviation of $X$
• $\mathcal{N}(0, 1)$: standard normal distribution with mean 0 and variance 1

The standardization formula shifts the distribution so the mean becomes zero (by subtracting $\mu$) and scales it so the standard deviation becomes one (by dividing by $\sigma$). This transformation preserves shape while relocating the distribution. The standardized value $Z$ tells us how many standard deviations $X$ lies from its mean; a $Z$ of 2 means two standard deviations above average.

This transformation allows us to use standard normal tables or functions to compute probabilities for any normal distribution. We only need to tabulate one distribution rather than infinitely many. When a financial analyst computes that a return is "two sigma below average," they're implicitly using this standardization: they've converted the return to a z-score to assess how unusual it is.

While returns may be approximated as normal in some settings, a normal price model assigns positive probability to negative prices. A log-normal model avoids that result by restricting the modeled price to strictly positive values. This is a property of the model, not an exceptionless market fact: common stock can become worthless or be cancelled. Modeling the logarithm of a positive price as normal produces the log-normal distribution.

If $\ln(X) \sim \mathcal{N}(\mu, \sigma^2)$, then $X$ follows a log-normal distribution. Under the common model in which period log returns $\ln(1+r_t)$ are jointly normal (including iid normal log returns), their sum is normal and the compounded price ratio is log-normal. Marginal normality of each period alone is not sufficient.

Under the Black-Scholes model, a stock price at a fixed future time is log-normal, which keeps the modeled price positive while preserving normal log-return calculations. For derivative valuation, the relevant distribution is the model's risk-neutral distribution; it should not be confused with an estimate of the stock's real-world return distribution. Within the model, percentage gains are unbounded above while simple-return losses are bounded at 100%.

Several other distributions appear frequently in quantitative finance, each suited to particular modeling contexts:

• Uniform distribution: Has constant density on a bounded interval, so subintervals of equal length have equal probability. Each individual point still has probability zero. It is used for random number generation and some Monte Carlo methods.
• Exponential distribution: Models waiting times between events, such as time until the next trade or default. Its "memoryless" property means the probability of an event occurring in the next moment does not depend on how long we have already waited.
• Poisson distribution: Counts events in fixed intervals, like number of trades per minute or credit events per year. Appropriate when events occur randomly and independently at a constant average rate.
• Student's t-distribution: Similar to normal but with heavier tails. A fitted t model can represent heavier marginal tails than a fitted normal model; whether it fits extreme returns better depends on the asset, horizon, parameters, dependence structure, and validation data. The t-distribution has a parameter (degrees of freedom) that controls tail heaviness, allowing it to interpolate between normal-like behavior and fat-tailed behavior.
• Chi-squared distribution: Under independent normal observations, a scaled sample variance has an exact chi-squared distribution. Other chi-squared tests rely on their own finite-sample or asymptotic assumptions, so this is not a generic law for volatility uncertainty.

When it exists, expected value is the distribution's probability-weighted mean. A long-run sample average converges to it only under law-of-large-numbers conditions such as iid repetitions with finite expectation, or an appropriate ergodic/dependence condition.

The expected value is a probability-weighted average. Each possible value contributes according to both its magnitude and its probability (or density), and these contributions are summed (or integrated). A rare outcome with sufficiently large magnitude can therefore have a material effect on the mean.

The parallel structure between the discrete and continuous formulas reflects a deeper unity: in both cases, we're computing a weighted average where the weights come from the probability distribution. The sum becomes an integral when the set of possible values becomes continuous, but the underlying logic remains the same.

For iid repetitions with finite expectation, the sample average converges to expected value. That statement concerns repetitions under a stable distribution; it does not imply that one stock's time average must approach a fixed annual expectation when its return process changes over time.

Consider a simplified binary stock model:

The expected return of 8% is not a possible outcome of one trial. For iid repetitions of this binary experiment, the sample average converges to 8% by the law of large numbers; any individual trial still produces either a 20% gain or a 10% loss.

Expected value satisfies several useful properties that make it indispensable for financial calculations:

Linearity: For any random variables $X$ and $Y$ and constants $a, b$:

where:

• $a, b$: constants (real numbers)
• $X, Y$: random variables (can be dependent or independent)
• $E[\cdot]$: expected value operator
• $aX + bY$: linear combination of the random variables
• $aE[X] + bE[Y]$: the same linear combination applied to the expected values

This property holds even if $X$ and $Y$ are dependent. The expectation "passes through" the linear combination regardless of any relationship between the variables. This is not true for most other summary measures. The variance of a sum, for example, depends critically on the correlation between variables. Linearity makes portfolio expected return calculations straightforward: the expected return of a portfolio is the weighted average of individual expected returns. If you hold 60% stocks with expected return 10% and 40% bonds with expected return 4%, the portfolio expected return is simply $0.6 \times 10\% + 0.4 \times 4\% = 7.6\%$, regardless of how stocks and bonds move together.

Expectation of a function: For a function $g(X)$ whose expectation exists:

where:

• $g(X)$: any function applied to the random variable $X$
• $g(x)$: the function evaluated at a specific value $x$
• $p_X(x)$: probability mass function (for discrete $X$)
• $f_X(x)$: probability density function (for continuous $X$)

This result, known as the Law of the Unconscious Statistician (LOTUS), is useful when the stated expectation is finite: we weight $g(x)$ by the original distribution of $X$ without first deriving the distribution of $g(X)$. It supports moment calculations and model-based derivative payoffs subject to their integrability conditions.

While expected value describes the center of a distribution, it tells us nothing about spread. Two investments might have the same expected return but vastly different risk profiles. Consider two stocks, both with 10% expected return. One might reliably return between 8% and 12%, while the other swings between -30% and +50%. Expected value alone cannot distinguish these dramatically different risk profiles. Variance quantifies this dispersion.

Variance squares deviations to remove signs and give larger deviations more weight. This symmetric quadratic penalty is a modeling choice; general risk aversion does not imply that gains and losses of equal size should receive identical quadratic treatment.

The second formula, $\text{Var}(X) = E[X^2] - (E[X])^2$, is computationally convenient. It says variance equals the "mean of the square minus the square of the mean." This formula is often easier to apply because it doesn't require centering the data before squaring. We can compute $E[X^2]$ and $E[X]$ separately and then combine them.

To see why these formulas are equivalent, expand the definition:

Since $\mu = E[X]$, this gives us $E[X^2] - (E[X])^2$. The derivation uses linearity of expectation: we can pass the expectation through the sum and pull constants outside, reducing the problem to computing $E[X^2]$ and $E[X]$.

Standard deviation is a standard measure of return volatility, not a complete measure of financial risk. A stock with 20% annualized return volatility has greater dispersion around its mean than one with 10% volatility. Under normality, roughly 68% of returns fall within one standard deviation of the mean, and 95% fall within two standard deviations. These percentages provide benchmarks for interpreting volatility: a 20% volatility stock with 10% expected return will, about two-thirds of the time, return between -10% and +30% in a given year.

The 14.7% standard deviation indicates substantial uncertainty around the 8% expected return. This volatility measure helps investors understand the range of outcomes they face and calibrate position sizes appropriately. A risk-averse investor might demand higher expected returns from this volatile investment compared to a more stable alternative.

Variance has different properties than expected value, which reflects its role in measuring spread rather than center:

Scaling: $\text{Var}(aX) = a^2 \text{Var}(X)$. Doubling a position quadruples variance, while standard deviation scales by $|a|$ and expected-return exposure scales by $a$. The quadratic statement applies to variance specifically, not to every risk measure.

Sum of independent variables: If $X$ and $Y$ are independent:

This result follows from independence: when $X$ and $Y$ are independent, their covariance is zero, eliminating the cross term that would otherwise appear. Independence means knowing the value of one variable provides no information about the other, so their variances add without reinforcement or cancellation.

Sum of dependent variables: In general:

where:

• $\text{Var}(X + Y)$: variance of the sum of $X$ and $Y$
• $\text{Var}(X)$, $\text{Var}(Y)$: individual variances
• $\text{Cov}(X, Y)$: covariance between $X$ and $Y$
• The factor of 2 arises because when expanding $(X + Y - \mu_{X+Y})^2 = ((X - \mu_X) + (Y - \mu_Y))^2$, the cross term $2(X - \mu_X)(Y - \mu_Y)$ appears, and its expectation is $2\text{Cov}(X, Y)$

The covariance term determines how asset interactions affect portfolio variance. For a two-asset combination with fixed marginal variances and weights of the same sign, negative covariance lowers variance relative to zero covariance. With opposite-sign weights, the covariance contribution reverses sign. Whether the portfolio is less volatile than every constituent also depends on weights, individual volatilities, and constraints.

When analyzing multiple assets, we need to understand how they move together. Covariance and correlation quantify this relationship and provide the mathematical foundation for portfolio construction and risk management. A portfolio's risk depends on each component's volatility and on how those components interact.

The covariance definition captures co-movement through products of deviations. When both variables are above their means, or both are below, the product is positive; opposite-direction deviations produce a negative product.

Positive covariance means that same-sign deviations make a positive net contribution on average, while negative covariance means opposite-sign deviations dominate on average. Zero covariance means no linear association; it does not rule out nonlinear dependence, so observing $X$ can still provide information about $Y$.

The equivalence of the two covariance formulas follows from expanding the definition:

The second formula, $E[XY] - E[X]E[Y]$, often simplifies calculations: it says covariance equals the expected product minus the product of expectations. If $X$ and $Y$ are independent, $E[XY] = E[X]E[Y]$, so the covariance is zero. Independence implies zero covariance, though the converse is not generally true.

Correlation is easier to interpret than covariance because it's unitless and bounded. A correlation of 1 indicates a perfect positive linear relationship, -1 indicates a perfect negative linear relationship, and 0 indicates no linear relationship. The normalization by standard deviations removes the scale dependence that makes covariance hard to interpret. Measuring the same returns in percentages rather than decimals is a fixed positive rescaling and leaves correlation unchanged. Currency translation is different: exchange rates generally vary over time, so converting asset values or returns between currencies introduces FX variation and can change correlations unless the conversion is a constant scaling.

The bounds of -1 and 1 follow from the Cauchy-Schwarz inequality, a fundamental result in mathematics. This bound provides a universal scale for comparison: a correlation of 0.8 between stocks A and B means they move together more strongly than if the correlation were 0.5, regardless of what A and B are or how volatile they are individually.

Low or negative correlation can reduce portfolio volatility relative to concentrated exposure, but correlation alone does not guarantee risk below every constituent. The two-asset variance also depends on both volatilities, the portfolio weights, and constraints.

Mean and variance describe the first two moments of a distribution, but they don't fully characterize it. Two distributions can have identical means and variances yet differ dramatically in their shapes. Higher moments capture asymmetry and tail behavior, which are both critical for understanding financial risk. Investors care about average outcomes, volatility, and the likelihood of extreme gains versus extreme losses.

The choice of the cubic power is not arbitrary. It's the lowest odd power that captures asymmetry. The first power (plain deviations) would sum to zero by definition of the mean. The second power (squared deviations) gives variance but loses sign information. The third power preserves the sign of each deviation, allowing positive and negative extremes to contribute differently. When the distribution has a long right tail with occasional extreme positive values, these large positive cubes dominate and yield positive skewness. A long left tail with extreme negative values yields negative skewness.

A distribution's skewness reveals the direction and magnitude of its asymmetry:

• Positive skewness: In the plotted skew-normal example, the right tail is longer and rare positive values dominate the third moment.
• Negative skewness: In the plotted skew-normal example, the left tail is longer and rare negative values dominate the third moment. Some equity-return samples and horizons show this pattern, but it is not universal across assets or regimes.
• Zero skewness: The third standardized moment is zero. A symmetric distribution with a finite third moment has zero skewness, but zero skewness does not by itself imply symmetry.

Skewness can matter even when two investments have the same mean and variance. Positive skew offers rare large gains, while negative skew exposes the investor to rare large losses. Whether an investor prefers one profile depends on the investor's utility, constraints, and the rest of the return distribution; skewness alone does not determine the choice.

Kurtosis uses fourth powers and therefore requires a finite fourth moment as a population quantity. A Student's t distribution with four degrees of freedom has no finite population fourth moment, so its population kurtosis is undefined; a finite sample still produces a numerical sample statistic, but that statistic is not estimating a finite t(4) kurtosis parameter.

Excess kurtosis compares a distribution's fourth standardized moment with the normal benchmark:

• Excess kurtosis > 0 (leptokurtic): A fourth standardized moment above the normal benchmark. Many financial-return samples exhibit positive excess kurtosis, but this alone does not guarantee larger tail probability at every cutoff.
• Excess kurtosis = 0 (mesokurtic): Equal to the normal distribution's fourth-moment benchmark; this does not imply the distribution is normal.
• Excess kurtosis < 0 (platykurtic): A fourth standardized moment below the normal benchmark; it does not guarantee uniformly lighter tails.

Many financial-return series have tails that a fitted normal model understates. Positive excess kurtosis is one warning sign, but tail probabilities should be checked directly because a fourth moment is not a complete description of tail behavior. Market moves during stressed periods can therefore be much more frequent than a normal calibration suggests without supporting a universal "once-in-a-century" label.

After scaling both models to unit variance, the t-distribution with 4 degrees of freedom has about 4.9 times the standard normal's upper-tail probability at $x=3$. The densities cross within the displayed tail region, so the t density is not higher at every threshold. This is a comparison between two specified models, not an estimate of a single "true" market probability or proof of a particular loss outcome. For risk management, the practical lesson is narrower: a model with lighter tails can assign a much smaller exceedance probability than a heavier-tailed alternative sufficiently far into the tail.

Conditional probability answers the question: "Given that event $B$ occurred, what's the probability of event $A$?" This concept is essential in finance, where we constantly update beliefs based on new information. Markets incorporate news continuously, so our probability assessments must evolve accordingly.

The conditional probability formula implements a natural idea: conditioning on $B$ restricts the probability measure to the event $B$ and renormalizes it. Within this restricted measure, we ask what share of the probability mass also belongs to $A$. The denominator $P(B)$ is the total mass assigned to $B$, while the numerator $P(A \cap B)$ is the mass assigned to both events.

The formula says: to find the probability of $A$ given $B$, we restrict attention to $B$ and divide the mass of $A \cap B$ by the mass of $B$. This restriction and renormalization is the essence of conditioning. For finite equiprobable outcomes, the ratio also equals a fraction of outcome counts, but that counting interpretation does not hold in general.

Suppose we're analyzing a corporate bond portfolio. Define:

• $A$ = bond defaults within one year
• $B$ = bond is rated BB (below investment grade)

If 5% of the portfolio are BB-rated bonds, 1% of all bonds default, and 0.3% of bonds are both BB-rated and default, then:

where:

• $P(\text{Default}|\text{BB})$: probability of default given the bond is BB-rated
• $P(\text{Default} \cap \text{BB}) = 0.003$: probability a bond is both BB-rated and defaults (0.3%)
• $P(\text{BB}) = 0.05$: probability a bond is BB-rated (5%)

BB-rated bonds have a 6% default probability, compared to 1% for the overall portfolio. Holding recovery, maturity, liquidity, taxes, and other relevant terms fixed, a higher default probability increases expected credit loss and can support a larger credit spread. The probability ratio alone does not determine a bond's yield. The calculation illustrates how conditioning on information, specifically the rating, changes our probability assessment.

Two events are independent if knowing that one occurred tells us nothing about the other. Independence is a useful simplifying assumption that, when valid, greatly simplifies probability calculations.

The first characterization captures the intuitive meaning of independence: observing $B$ provides no information about $A$, so our probability assessment for $A$ remains unchanged. The second characterization, the multiplication rule, provides a computational criterion: if the joint probability equals the product of marginal probabilities, the events are independent.

Independence is a powerful simplifying assumption. Many liquid-asset return series have small linear autocorrelations, but that does not establish independence: absolute and squared returns can remain dependent through volatility clustering. If returns are independent under a stated model, multi-day joint probabilities factor into products. The assumption should be tested against the dependence relevant to the calculation.

Bayes' Theorem provides a systematic method for updating probabilities when new information arrives, establishing the mathematical basis for learning from data and adapting beliefs. These skills are essential in finance, where conditions change constantly.

Bayes' Theorem follows directly from the definition of conditional probability applied twice. Starting from $P(A|B) = P(A \cap B)/P(B)$ and noting that $P(A \cap B) = P(B|A) \cdot P(A)$ (by rearranging the conditional probability definition for $B$ given $A$), we obtain the theorem. Despite this simple derivation, the theorem has practical implications for reasoning under uncertainty.

The components have specific names that reflect their roles in the updating process:

• $P(A)$: Prior probability, representing our belief about $A$ before observing $B$
• $P(B|A)$: Likelihood, measuring how probable the evidence $B$ is if $A$ is true
• $P(A|B)$: Posterior probability, representing our updated belief about $A$ after observing $B$
• $P(B)$: Evidence probability, which is a normalizing constant

Once a prior and likelihood model are specified, the theorem provides the rule for computing the posterior after observing evidence. The posterior can then become the prior for the next round of updating as more evidence arrives.

A bank is evaluating a corporate borrower. Based on the firm's industry and size, the bank initially estimates a 3% probability of default within one year. This is the prior probability.

The bank then receives the firm's quarterly financial statements showing deteriorating profit margins. Historical estimates from a comparable borrower cohort, measured at the same observation point before a one-year forecast horizon, show:

• 40% of companies that defaulted within the following year showed deteriorating margins at the observation date
• 10% of companies that did not default within that same year showed deteriorating margins at the observation date

The bank wants to update its default probability given this new information.

Step 1: Define events

• $D$ = company defaults within one year
• $M$ = company shows deteriorating margins

Step 2: List known probabilities

• $P(D) = 0.03$ (prior default probability)
• $P(D^c) = 0.97$ (prior probability of no default)
• $P(M|D) = 0.40$ (likelihood of margin deterioration given default)
• $P(M|D^c) = 0.10$ (likelihood of margin deterioration given no default)

Step 3: Calculate $P(M)$ using the law of total probability

Before applying Bayes' Theorem, we need the total probability of observing deteriorating margins, regardless of whether default occurs. The law of total probability provides this by considering all mutually exclusive ways the evidence could arise:

where:

• $P(M)$: total probability of observing deteriorating margins
• $P(M|D)$: probability of deteriorating margins given the company defaults
• $P(D)$: prior probability of default
• $P(M|D^c)$: probability of deteriorating margins given no default
• $P(D^c)$: probability of no default

This formula works because every company either defaults or doesn't, so we can decompose the probability of deteriorating margins into these two mutually exclusive cases. We weight each conditional probability by the probability of that case occurring. The law of total probability essentially averages the conditional probabilities, weighted by the probability of each conditioning event.

The deteriorating margins more than tripled our assessed default probability from 3% to about 11%. This updated probability should inform lending decisions, pricing, and reserve requirements. The magnitude of this update reflects both the strength of the evidence, since deteriorating margins are much more common among defaulters, and the prior belief that default was already considered unlikely.

The following visualization shows how the prior probability updates to the posterior as we incorporate new evidence.

This section brings together the concepts from this chapter by simulating stock returns and computing risk measures. This exercise demonstrates how probability distributions translate to financial risk analysis.

We'll simulate iid normal daily simple returns as a local approximation and compute key statistics. Because a normal law is unbounded, the model assigns positive probability to returns at or below -100%; the seeded draw is validated before applying $\log(1+r)$.

Now we calculate the sample mean, standard deviation, skewness, and kurtosis.

For this seed, annualized volatility is about 19.79%, close to the 20% input, while the annualized sample mean is about 22.10%, well above the 10% input. The gap illustrates how noisy a mean estimate can remain with 1,260 daily observations. Near-zero sample skewness and excess kurtosis are consistent with normal draws, but those two statistics alone do not confirm normality; here the generating call establishes the normal model.

Value at Risk (VaR) is a quantile threshold for loss over a specified horizon. Under a continuous calibrated distribution, a 95% VaR has 5% probability beyond the threshold: 5% is one period in twenty in probability terms, not a fixed schedule of exceedances. With discrete or empirical distributions, ties and the chosen quantile convention can change the exact fraction. VaR is neither the worst possible loss nor the expected loss beyond that threshold. The code below reports signed lower-tail return cutoffs. If loss is defined as $L=-R$, conventional positive loss VaR is the negative of the corresponding return cutoff.

Starting from an initial price, we can construct a price path using cumulative returns.

The simulated price path is one realization under the model. The 10% input is an annualized arithmetic mean of daily simple returns, whereas 22.31% is the geometric CAGR of this realized path, so equality is not a model target. Sampling variation explains why this seed's annualized sample arithmetic mean is 22.10% rather than 10%. The separate move from that sample mean to the 22.31% CAGR comes from geometrically compounding the realized daily sequence; it is not another estimate of the arithmetic-mean input.

The key parameters for simulating and analyzing financial returns are:

• annual_return: Annualized arithmetic mean of iid daily simple returns (10% here), so the daily mean is $0.10/252$. It is not an exact target for the one-year compounded return, which under this model has expectation $(1+0.10/252)^{252}-1$.
• annual_volatility: Annualized standard deviation under iid or zero-autocovariance scaling; daily volatility is the annual value divided by $\sqrt{252}$.
• trading_days: Modeling convention for trading days per year (commonly 252). Exact counts vary by market and calendar year.
• confidence_level: For VaR calculations, typically 95% or 99%. Higher confidence means more conservative risk estimates.
• initial_price: Starting price for the simulation. All subsequent prices are computed relative to this value.

Probability theory provides powerful tools for financial modeling, but practitioners must understand its limitations.

The assumption of known, stable probability distributions rarely holds perfectly in financial markets. Market regimes shift, causing parameters such as volatility and dependence to change over time. In stressed periods, correlations among many risky assets can rise, weakening some diversification benefits, although the pattern is heterogeneous and not every pair approaches one. A model calibrated only on a calm historical window may therefore represent a later regime poorly.

Tail misspecification presents another fundamental challenge. Many financial-return series have extreme observations that a fitted normal model assigns very little probability. In those settings, a normal model understates tail risk and can produce risk limits that are too low unless it is supplemented with stress scenarios or a better tail model. That statistical limitation does not, by itself, establish a single causal explanation for any financial crisis.

The gap between sample statistics and true parameters also matters. With finite data, our estimates of means, variances, and correlations contain sampling error. Optimization procedures that treat estimated parameters as true values can generate portfolios that overfit to noise and perform poorly out of sample. For an independent sample with finite variance, the standard error of a sample mean shrinks only at the square-root rate, so the history required depends on the process, estimator, horizon, and desired precision.

Despite these limitations, probability theory supplies a consistent language for specified financial tasks. Quantiles such as VaR summarize loss thresholds under a model or empirical distribution. Risk-neutral expectations support derivative valuation under stated assumptions. Expected returns and covariance matrices make portfolio trade-offs explicit. These methods influence practice, but their usefulness depends on estimation quality, model fit, and the decision constraints around them.

The key is using these tools while remaining aware of their assumptions. Supplement parametric models with stress tests. Use longer-tailed distributions when appropriate. Update beliefs as new data arrives, following Bayes' theorem. All models are approximations: useful, but not reality.

This chapter covered the probability theory foundations essential for quantitative finance.

We began with sample spaces, measurable events, and the Kolmogorov axioms that define probability measures. Discrete variables use probability mass functions; absolutely continuous variables can be represented with densities, while every random variable has a CDF.

Expected value provides a probability-weighted average, representing the theoretical mean outcome. Variance measures dispersion around this mean, with standard deviation serving as a standard measure of return volatility rather than a complete measure of financial risk. Higher moments (skewness and kurtosis) capture asymmetry and tail behavior, revealing patterns that mean and variance miss.

Conditional probability quantifies how learning new information updates our beliefs. Bayes' Theorem formalizes this updating process, and gives a systematic method for incorporating evidence. The credit risk example demonstrated how new financial data can materially revise default probability estimates.

Key distributions in finance include normal models for returns and log-normal models for prices. However, many empirical return series have heavier tails than a fitted normal distribution, and some asset classes and horizons exhibit negative skewness. These departures from normality matter for risk management.

The practical simulation tied these concepts together: generating returns from probability distributions, computing sample statistics, calculating risk measures like Value at Risk, and constructing price paths. These techniques provide the computational foundation for more advanced quantitative methods.

With these probability foundations, you can tackle portfolio theory, time series analysis, and derivative pricing in the chapters ahead. Each builds directly on the concepts of distributions, expected values, and conditional probabilities introduced here.

Ready to test your understanding? Take this quick quiz to reinforce what you've learned about probability theory fundamentals.