Variance Inflation Factor and Multicollinearity Diagnosis

College Depth 83 in the knowledge graph I know this Set as goal
Unlocks 2 downstream topics
multicollinearity diagnostics vif

Core Idea

The Variance Inflation Factor (VIF) quantifies how much a coefficient's variance is inflated by multicollinearity: VIF = 1/(1 - Rⱼ²), where Rⱼ² comes from regressing regressor j on all others. VIF values above 5–10 typically indicate problematic multicollinearity requiring remediation.

Explainer

From your study of multicollinearity, you know the problem: when two or more regressors are highly linearly related, OLS cannot cleanly attribute variation in Y to one variable versus the other. The estimates are still unbiased — OLS is not broken — but they become imprecise. Standard errors blow up, t-statistics shrink, and coefficients can appear statistically insignificant even when the variables genuinely matter. What you need is a way to measure how severe this imprecision is for each coefficient individually. That is exactly what the Variance Inflation Factor provides.

The logic behind the VIF formula is elegant. For regressor j, run a separate regression: regress Xⱼ on all the *other* regressors and record the R² from that auxiliary regression, calling it Rⱼ². This Rⱼ² measures how well the other regressors can predict Xⱼ — in other words, how redundant Xⱼ is given the rest of the model. The VIF is then 1/(1 − Rⱼ²). When Rⱼ² = 0 (Xⱼ is completely unrelated to the other regressors), VIF = 1: no inflation, the coefficient's variance is exactly what it would be in a simple regression. When Rⱼ² = 0.9 (90% of Xⱼ's variation is explained by the others), VIF = 10: the variance of β̂ⱼ is ten times larger than it would be without multicollinearity. The standard error is thus √10 ≈ 3.16 times wider, dramatically shrinking t-statistics.

The conventional thresholds — VIF > 5 causes concern, VIF > 10 indicates serious problems — are rules of thumb, not mathematical cutoffs. What they communicate is that once VIF exceeds these values, your coefficient estimates are so imprecise that meaningful inference is difficult. A VIF of 25 means the standard error is five times larger than it would be in an orthogonal design; you would need a sample roughly 25 times larger to achieve the same precision. Understanding this relationship makes the diagnosis concrete: a high VIF is not a mysterious pathology but a quantitative statement about how much statistical power you are losing.

Remedies depend on the source of multicollinearity. If two regressors measure nearly the same thing conceptually, you can drop one or combine them into an index. If multicollinearity arises from the functional form (including both X and X² creates high correlation), centering the variable before squaring often helps. If you must retain both variables because theory requires them, the practical implication is humility: wide confidence intervals are honest, and you should report them as such rather than over-interpreting coefficient magnitudes. VIF does not tell you what to do, but it gives you the quantitative basis for understanding why your estimates are uncertain and how much worse the problem would have to get before the model becomes uninformative.

Practice Questions 5 questions

Prerequisite Chain

Counting to 10Counting to 20Understanding ZeroThe Number ZeroCounting to FiveOne-to-One CorrespondenceCombining Small Groups Within 5Addition Within 10Addition Within 20Two-Digit Addition Without RegroupingTwo-Digit Addition with RegroupingAddition Within 100Repeated Addition as MultiplicationMultiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Two-Digit by One-Digit DivisionDivision with RemaindersRemainders and Quotients in DivisionDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueReading and Writing DecimalsComparing and Ordering DecimalsAdding and Subtracting DecimalsMultiplying DecimalsDividing DecimalsDividing FractionsMixed Number ArithmeticOrder of OperationsInteger Order of OperationsVariable ExpressionsCombining Like TermsOne-Step EquationsTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesAngle Pairs: Complementary, Supplementary, and VerticalParallel Lines and TransversalsCorresponding AnglesAlternate Interior AnglesTriangle Angle Sum TheoremExterior Angle TheoremTriangle Inequality TheoremSimilar Triangles: AA SimilaritySimilar Triangles: SSS and SAS SimilarityProportions in Similar TrianglesRight Triangle Trigonometry IntroductionTrigonometric Ratios ReviewRadian MeasureConverting Between Degrees and RadiansThe Unit CircleGraphing Sine and CosineGraphing Tangent and Reciprocal Trigonometric FunctionsDerivatives of Trigonometric FunctionsAntiderivativesIndefinite IntegralsBasic Integration RulesRiemann SumsDefinite Integral DefinitionProbability Density Functions and Continuous DistributionsCumulative Distribution FunctionsContinuous Random VariablesNormal DistributionCentral Limit TheoremConfidence Intervals for MeansZ-Tests and T-Tests for MeansOne-Sample Z-Test for MeansOne-Sample and Two-Sample T-TestsOne-Way ANOVAF-Test and Joint SignificanceR-Squared and Model FitMulticollinearityVariance Inflation Factor and Multicollinearity Diagnosis

Longest path: 84 steps · 422 total prerequisite topics

Prerequisites (2)

Leads To (2)