Credit Risk Modeling Approaches › Credit Scoring and Machine Learning Approaches

While structural and reduced-form models derive from financial theory, credit scoring uses historical data to predict which borrowers will default based on observable characteristics. This approach dominates retail lending (mortgages, credit cards, personal loans) and increasingly complements market-based models for corporate credit. Credit scoring identifies statistical patterns in observable characteristics that distinguish defaulters from non-defaulters. It does not model economic mechanisms like structural approaches.

Logistic regression models the probability of default as a function of borrower characteristics. The model turns a linear combination of features (financial ratios, firm characteristics) into a probability between 0 and 1 using the logistic function:

$$P(\text{default}) = \frac{1}{1 + e^{-(\beta_0 + \beta_1 x_1 + \cdots + \beta_k x_k)}}$$

where:

• $P(\text{default})$: predicted probability of default (bounded between 0 and 1)
• $k$: number of borrower characteristics (features) in the model
• $x_i$: borrower characteristic $i$ for $i = 1, \ldots, k$ (e.g., debt-to-equity ratio, profitability, liquidity measures)
• $\beta_0$: intercept term (baseline log-odds when all features are zero)
• $\beta_i$: coefficient for feature $x_i$, representing the change in log-odds per unit change in $x_i$
• $e$: Euler's number (base of natural logarithm, approximately 2.71828)
• $\beta_0 + \beta_1 x_1 + \cdots + \beta_k x_k$: linear combination forming the log-odds or credit score
• The logistic function $\frac{1}{1+e^{-z}}$ turns the unbounded log-odds $z$ into a probability between 0 and 1

The linear combination $z = \beta_0 + \beta_1 x_1 + \cdots + \beta_k x_k$ is called the log-odds or credit score. The logistic function, also known as the sigmoid function, turns this potentially unbounded score into a proper probability.

The logistic function has several attractive properties for classification problems. It is monotonically increasing, so higher scores always correspond to higher default probability, which allows straightforward ranking of borrowers by risk. It asymptotically approaches 0 and 1 at the extremes, so predictions are always valid probabilities regardless of how extreme the input features become. It has a simple derivative that facilitates maximum likelihood estimation, making parameter fitting computationally tractable even for large datasets. The coefficients $\beta_i$ have a clear interpretation: each coefficient represents the change in log-odds per unit change in the corresponding feature $x_i$. A positive coefficient means higher values of that feature increase default probability, while a negative coefficient means higher values decrease default probability.

The coefficient visualization provides immediate insight into which factors drive default risk in the model. Debt-to-equity ratio is the only positive coefficient, indicating that higher leverage raises predicted default risk. All other features have negative coefficients, meaning higher values reduce default probability. Interest coverage shows the strongest protective effect, followed by profit margin and the current ratio; together they reflect the importance of debt-service capacity, profitability, and liquidity. Asset turnover has a smaller but still negative effect, suggesting operationally efficient firms face lower default risk.

Edward Altman's 1968 Z-score remains widely used for bankruptcy prediction. It demonstrates that simple models with clear economic interpretation can be highly effective. The model combines five financial ratios that collectively capture liquidity, profitability, leverage, solvency, and activity:

$$Z = 1.2X_1 + 1.4X_2 + 3.3X_3 + 0.6X_4 + 1.0X_5$$

where:

• $Z$: composite bankruptcy risk score
• $X_1$: Working Capital / Total Assets (measures liquidity and short-term financial health)
• $X_2$: Retained Earnings / Total Assets (measures cumulative profitability and firm age)
• $X_3$: EBIT / Total Assets (measures operating efficiency and profitability before interest and taxes)
• $X_4$: Market Value of Equity / Book Value of Debt (measures leverage and market confidence in the firm)
• $X_5$: Sales / Total Assets (measures asset turnover and revenue generation efficiency)
• The coefficients 1.2, 1.4, 3.3, 0.6, and 1.0 were determined empirically through discriminant analysis on historical bankruptcy data
• Higher $Z$-scores indicate lower bankruptcy risk, lower scores indicate higher risk

Firms with $Z < 1.81$ are classified as distressed, indicating high default risk. Values with $Z > 2.99$ indicate healthy firms with low default risk. Values between 1.81 and 2.99 fall in the gray zone where classification is uncertain.

The Z-score's enduring popularity stems from its simplicity and interpretability. Each ratio captures a different dimension of financial health: $X_1$ measures liquidity, the firm's ability to meet short-term obligations. $X_2$ captures cumulative profitability and implicitly firm age, since retained earnings accumulate over time. $X_3$ measures operating performance, the core earnings power of the business before financing decisions. $X_4$ combines market information with book values, capturing both leverage and the market's confidence in the firm's prospects. $X_5$ measures asset efficiency, how effectively the firm uses its assets to generate revenue. The weights reflect their relative importance in predicting bankruptcy, with operating profitability ($X_3$) receiving the highest weight of 3.3, indicating it is the strongest discriminator between healthy and distressed firms.

Company A demonstrates financial health with a Z-score above 3, placing it firmly in the safe zone with low default risk. The strong working capital position indicates liquidity to meet short-term obligations. High retained earnings relative to assets suggest mature profitability and financial stability accumulated over time. Healthy EBIT margins demonstrate operating efficiency, while the favorable ratio of market equity to book debt reflects both low leverage and market confidence in the firm's prospects. In contrast, Company B shows financial distress with a Z-score below 1.81, indicating high default risk. Negative working capital is a serious warning sign, suggesting the firm may struggle to pay current obligations. Weak profitability ratios indicate the core business is not generating adequate returns. High leverage relative to market equity suggests the firm is overleveraged, with debt exceeding what the market believes the equity is worth. These results show how the Z-score effectively synthesizes multiple financial dimensions into a single risk metric. It can be easily communicated and compared across firms.

The Receiver Operating Characteristic (ROC) curve visualizes how well a credit scoring model separates defaulters from non-defaulters across different probability thresholds. This diagnostic tool is essential for evaluating and comparing credit models.