Multicollinearity › Advanced Diagnostic Techniques

Beyond basic VIF analysis, we can employ more sophisticated diagnostic measures to understand multicollinearity from different perspectives.

The condition index provides another lens through which to view multicollinearity by examining the eigenvalues of the correlation matrix:

$$\text{Condition Index} = \sqrt{\frac{\lambda_{\max}}{\lambda_{\min}}}$$

Eigenvalues describe the "stretch" of data in different directions:

• Large eigenvalues: Indicate directions where data varies considerably
• Small eigenvalues: Indicate directions with little variation (suggesting multicollinearity)
• Condition Index: Measures how "stretched" the data becomes (high values = multicollinearity)

Interpretation guidelines:

• Condition Index < 10: No multicollinearity
• Condition Index 10-30: Moderate multicollinearity
• Condition Index > 30: High multicollinearity

Tolerance measures the proportion of variance in a variable not explained by other predictors:

$$\text{Tolerance} = 1 - R_j^2 = \frac{1}{\text{VIF}_j}$$

Interpretation guidelines:

• Tolerance > 0.2: Generally acceptable (unique information)
• Tolerance 0.1-0.2: Moderate multicollinearity (some redundancy)
• Tolerance < 0.1: High multicollinearity (highly redundant)

Let's examine these advanced diagnostics with our health dataset: