A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Selection Bias

College Depth 117 in the knowledge graph I know this Set as goal
69topics build on this
587prerequisites beneath it
See this on the map →
EndogeneityPotential Outcomes and the Rubin Causal Model+2 moreDifference-in-DifferencesInstrumental Variables
selection-bias self-selection observational-data non-random-treatment

Core Idea

Selection bias occurs when the units who receive treatment systematically differ from controls in ways that also affect the outcome, making the treated group a non-representative counterfactual for the untreated. A classic example: estimating returns to job training by comparing trainees to non-trainees, when those who chose to train were already more motivated. Selection on observables (confounding) can be addressed by controlling for all relevant characteristics; selection on unobservables requires an instrument, a discontinuity, or a differencing strategy. Heckman's selection model handles selection into a sample from a latent participation equation.

Common Misconceptions

Explainer

From the potential outcomes framework, you know that the causal effect of treatment for individual i is Yᵢ(1) − Yᵢ(0) — the difference between what would happen with and without treatment. The fundamental problem is that we observe only one of these potential outcomes. To estimate the average treatment effect (ATE) or the average treatment effect on the treated (ATT), we need a valid comparison group that stands in for the unobserved counterfactual. Selection bias is what goes wrong when that comparison group is systematically different in ways that also affect outcomes.

A canonical example: you want to estimate the wage return to a job training program. You compare wages of program completers to non-participants. If those who enrolled were already more motivated, more skilled, or more attached to the labor market — traits that raise wages independently of training — then the comparison group (non-participants) has lower baseline potential wages, even in the absence of training. The naive estimate E[Y|D=1] − E[Y|D=0] overstates the treatment effect because it conflates the effect of training with the pre-existing advantage of trainees. Formally: the naive estimator equals ATT + selection bias, where selection bias = E[Y(0)|D=1] − E[Y(0)|D=0]. If those who select into treatment would have earned more anyway (positive selection), the naive estimator is upward biased.

The endogeneity you studied earlier is the formal statement of the same problem: the treatment variable D is correlated with the error term, which here represents unobservable determinants of the outcome. Selection on observables means that conditional on measured covariates X, treatment assignment is independent of potential outcomes — the selection is fully explained by X. In this case, controlling for X (via regression, matching, or inverse probability weighting) recovers an unbiased estimate. The key assumption is that you've measured all the relevant confounders; if any important confounder is omitted, bias remains.

Selection on unobservables is the harder case: the treated and control groups differ in unmeasured ways. No amount of controlling for observed covariates fixes this. Matching balances the distribution of X between treated and control, but it cannot create balance on unobserved variables. This is why causal inference requires quasi-experimental strategies — instrumental variables exploit an external source of variation in treatment assignment that is uncorrelated with outcomes except through treatment; difference-in-differences removes fixed group-level confounders by comparing changes over time; regression discontinuity exploits threshold-based assignment to approximate random assignment near the cutoff. Each strategy targets a specific type of selection story and requires its own identifying assumption about what is and isn't correlated with potential outcomes.

Practice Questions 5 questions

Prerequisite Chain

Understanding ZeroThe Number ZeroCounting to FiveCounting to 10Counting to 20Counting a Set of Objects Up to 20Cardinality: The Last Number CountedMatching Numerals to QuantitiesSubitizing Small QuantitiesAddition Within 10Number Bonds to 10Addition Within 20Doubles and Near DoublesDoubles Facts Within 10Near Doubles Facts Within 20Mental Math Strategies for AdditionMental Math: Adding and Subtracting TensAddition Within 100Repeated Addition as MultiplicationMultiplication as Equal GroupsMultiplication: ArraysBasic Multiplication Facts (0s, 1s, 2s, 5s, 10s)Multiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Multiplication and Division Fact FamiliesRelationship Between Multiplication and DivisionDivision Facts as Inverse of MultiplicationRemainders and Quotients in DivisionDivision Word ProblemsMulti-Step Word ProblemsSolving Multi-Step Word ProblemsMultiplication Word ProblemsDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueIntegers and the Number LineComparing and Ordering IntegersAbsolute ValueAdding IntegersSubtracting IntegersMultiplying IntegersDividing IntegersUnit RatesProportionsPercent ConceptConverting Between Fractions, Decimals, and PercentsOperations with Rational NumbersTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesAngle Pairs: Complementary, Supplementary, and VerticalParallel Lines and TransversalsCorresponding AnglesAlternate Interior AnglesTriangle Angle Sum TheoremExterior Angle TheoremTriangle Inequality TheoremSimilar Triangles: AA SimilaritySimilar Triangles: SSS and SAS SimilarityProportions in Similar TrianglesRight Triangle Trigonometry IntroductionSine, Cosine, and Tangent RatiosTrigonometric Ratios ReviewRadian MeasureConverting Between Degrees and RadiansThe Unit CircleGraphing Sine and CosineGraphing Tangent and Reciprocal Trigonometric FunctionsDerivatives of Trigonometric FunctionsAntiderivativesIndefinite IntegralsBasic Integration RulesRiemann SumsDefinite Integral DefinitionProbability Density Functions and Continuous DistributionsCumulative Distribution FunctionsContinuous Random VariablesProbability Density FunctionsExpected ValueWeak Law of Large NumbersProbability Axioms and RulesConditional ProbabilityIndependence of EventsSampling DistributionsStandard Error of EstimatorsHypothesis Testing: Framework and LogicP-values and Statistical SignificanceEffect Size and Practical SignificanceHypothesis Testing: Framework and LogicZ-Tests and T-Tests for MeansOne-Sample Z-Test for MeansOne-Sample and Two-Sample T-TestsInference in Linear RegressionPrediction Intervals in RegressionLinear Regression BasicsResiduals and Goodness of Fit (R²)Simple (Bivariate) OLS RegressionClassical OLS Assumptions (Gauss-Markov)Multiple RegressionInterpreting Regression CoefficientsHypothesis Testing in RegressionF-Test and Joint SignificanceR-Squared and Model FitOmitted Variable BiasCausal Inference and the Identification ProblemPotential Outcomes and the Rubin Causal ModelSelection Bias

Longest path: 118 steps · 587 total prerequisite topics

Prerequisites (4)

Leads To (2)