A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Matching, Stratification, and Weighting: Creating Comparable Groups

Graduate Depth 112 in the knowledge graph ☐ I know this ☆ Set as goal
3topics build on this
656prerequisites beneath it
See this on the map →
Propensity Score Methods and EstimationCausal Inference from Observational Data+3 more→→Sensitivity Analysis: Robustness to Unmeasured Confounding
matching stratification weighting covariate-balance

Core Idea

Matching, stratification, and weighting create comparable groups by balancing covariate distributions between treated and control units. Propensity score methods use a summary of confounders for balance. These identify causal effects under unconfoundedness.

Explainer

The core problem these methods address is one you already understand from causal inference: in observational data, treatment and control groups differ not just in their treatment status but in the background characteristics that led to treatment in the first place. People who receive a job training program tend to be more motivated than those who don't; countries that adopt a policy tend to differ systematically from those that don't. Naive comparisons produce confounding bias — the treatment effect is mixed up with the effect of these background differences. Matching, stratification, and weighting all attack this problem by constructing comparison groups that are as similar as possible to the treated group on observed confounders.

Exact matching is the most intuitive approach: for each treated unit, find a control unit with identical values on all confounders. A 45-year-old woman with a college degree who lives in a urban county gets matched to another 45-year-old woman with a college degree who lives in an urban county but did not receive treatment. The treatment effect estimate is the average difference in outcomes across matched pairs. The problem is the curse of dimensionality — with many confounders, exact matches become impossible because no two units share the same profile across ten or twenty variables. This is why propensity score methods, which you studied in your prerequisite, are so useful: they collapse all the confounders into a single number (the predicted probability of treatment), so matching on one dimension achieves approximate balance on all.

Stratification divides the sample into strata (blocks) with similar propensity scores and estimates the treatment effect within each stratum, then averages across strata. Inverse probability weighting (IPW) takes a different approach: rather than selecting matched pairs, it reweights the entire sample so that the covariate distribution in the control group resembles the treated group. Units in the control group who look like treated units receive high weights; those who don't look like treated units receive low weights. Both approaches rest on the same mathematical insight — that under unconfoundedness (all confounders observed and measured), the propensity score is sufficient to remove selection bias.

The assumptions underlying these methods deserve scrutiny. Unconfoundedness — also called ignorability or "no unmeasured confounders" — is the key identifying assumption, and it cannot be tested from the data itself. It requires that you have measured every variable that jointly influences treatment assignment and the outcome. In practice this means that these methods are only as good as your covariate set: variables you forgot to measure or cannot measure (parental motivation, employer discrimination) remain as unmeasured confounders. The other assumption is overlap (or common support) — for every value of the covariates, there must be some probability of being in either treatment or control. If a certain type of person *always* receives treatment and *never* doesn't, there is no valid counterfactual for them. Diagnostics like checking propensity score distributions and testing covariate balance after matching — not before — are how you evaluate whether these assumptions hold in practice and whether your comparison groups are genuinely comparable.

What did you take from this?

Topics in reflective domains aren't scored by quiz answers. Read, reflect, and mark when you've thought it through.

Quiz me anyway →

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Number Bonds to 10 → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Dividing Integers → Unit Rates → Proportions → Percent Concept → Converting Between Fractions, Decimals, and Percents → Operations with Rational Numbers → Two-Step Equations → Solving Multi-Step Equations → Equations with Variables on Both Sides → Angle Pairs: Complementary, Supplementary, and Vertical → Parallel Lines and Transversals → Corresponding Angles → Alternate Interior Angles → Triangle Angle Sum Theorem → Exterior Angle Theorem → Triangle Inequality Theorem → Similar Triangles: AA Similarity → Similar Triangles: SSS and SAS Similarity → Proportions in Similar Triangles → Right Triangle Trigonometry Introduction → Sine, Cosine, and Tangent Ratios → Trigonometric Ratios Review → Radian Measure → Converting Between Degrees and Radians → The Unit Circle → Graphing Sine and Cosine → Graphing Tangent and Reciprocal Trigonometric Functions → Derivatives of Trigonometric Functions → Antiderivatives → Indefinite Integrals → Basic Integration Rules → Riemann Sums → Definite Integral Definition → Probability Density Functions and Continuous Distributions → Cumulative Distribution Functions → Continuous Random Variables → Probability Density Functions → Expected Value → Weak Law of Large Numbers → Probability Axioms and Rules → Conditional Probability → Independence of Events → Sampling Distributions → Standard Error of Estimators → Hypothesis Testing: Framework and Logic → P-values and Statistical Significance → Effect Size and Practical Significance → Hypothesis Testing: Framework and Logic → Z-Tests and T-Tests for Means → One-Sample Z-Test for Means → One-Sample and Two-Sample T-Tests → Inference in Linear Regression → Prediction Intervals in Regression → Linear Regression Basics → Residuals and Goodness of Fit (R²) → Simple (Bivariate) OLS Regression → Classical OLS Assumptions (Gauss-Markov) → Maximum Likelihood Estimation → Logit and Probit Models for Binary Outcomes → Propensity Score Methods and Estimation → Matching, Stratification, and Weighting: Creating Comparable Groups

Longest path: 113 steps · 656 total prerequisite topics

Prerequisites (5)

Leads To (1)