Natural Experiments and Quasi-Experimental Design

Graduate Depth 191 in the knowledge graph I know this Set as goal
Unlocks 8 downstream topics
quasi-experimental exogenous-variation policy-evaluation

Core Idea

Natural experiments leverage exogenous (policy-driven, geographic, or temporal) variation in exposure that is not controlled by individuals or affected by their underlying risk. When assignment is essentially random or unrelated to confounders, natural experiments provide causal evidence comparable to randomized trials despite their observational nature.

Explainer

You know from the counterfactual framework that causal inference requires comparing what actually happened to what *would have* happened under a different exposure — a comparison that is never directly observable. The entire architecture of epidemiologic study design is an attempt to construct a credible version of that counterfactual comparison. Randomized controlled trials do this by design: random assignment means the exposed and unexposed groups are exchangeable, so the control group's outcomes genuinely represent what the treatment group would have experienced had they not been treated. The problem is that most exposures of interest — poverty, pollution, smoking, diet, childhood adversity — cannot be ethically or practically randomized. Natural experiments are the epidemiologist's way of finding the randomization that the world occasionally provides for free.

A natural experiment exploits a source of exogenous variation — variation in exposure that is driven by forces external to the individuals being studied and unrelated to their underlying health or risk profile. The classic example is John Snow's cholera investigation: households on different sides of a street happened to receive water from different suppliers (the Southwark and Vauxhall company vs. the Lambeth company), based on historical infrastructure decisions that predated any knowledge of cholera's transmission. That historical accident functioned like random assignment. More recent examples include policy cutoffs (individuals on either side of an income threshold that determines program eligibility), geographic boundaries (counties on either side of a state border with different policies), weather shocks (droughts or floods affecting crop prices), and lottery assignments (military draft lotteries, housing lottery assignments).

The validity of a natural experiment rests on a key assumption: the assignment mechanism is as-good-as-random with respect to confounders. This is usually argued, not proven — you assess whether observable characteristics are balanced across exposure groups (as you would after randomization), examine the plausibility of the assignment mechanism, and look for violations like sorting of individuals in anticipation of the policy. A regression discontinuity design exploits a sharp threshold: people just below a cutoff serve as the counterfactual for people just above it, on the assumption that just-below and just-above groups are essentially identical except for their exposure status. A difference-in-differences design compares changes over time in exposed versus unexposed groups, assuming that in the absence of the exposure, trends would have been parallel. Each design has a specific identifying assumption that can be interrogated.

What natural experiments can and cannot tell you is shaped by the nature of the exogenous variation. Because the variation is often local and specific — a particular policy change, in a particular place, at a particular time — the external validity of natural experiment findings may be limited. The effect you estimate may be specific to the population near the threshold, or to the magnitude of the policy change, rather than generalizable to the full range of exposures. This is the local average treatment effect (LATE) problem in instrumental variable contexts: the estimated effect pertains to the subpopulation whose exposure was actually changed by the instrument, which may not be representative. Interpreting natural experiment results requires being explicit about what population and what contrast the design is actually estimating.

Natural experiments have produced some of the most influential findings in social epidemiology and health policy precisely because they credibly address confounding in settings where experiments are impossible. The Barker hypothesis about developmental origins of disease, the effect of folic acid fortification on neural tube defects, the long-term effects of early childhood interventions, the health effects of unemployment — all have been illuminated by natural experiments. Their power lies in the fact that the world sometimes creates, through policy accidents, geographic quirks, or natural disasters, the separation of exposure and confounders that experimenters create by design.

Practice Questions 5 questions

Prerequisite Chain

Counting to 10Counting to 20Understanding ZeroThe Number ZeroCounting to FiveOne-to-One CorrespondenceCombining Small Groups Within 5Addition Within 10Addition Within 20Two-Digit Addition Without RegroupingTwo-Digit Addition with RegroupingAddition Within 100Repeated Addition as MultiplicationMultiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Two-Digit by One-Digit DivisionDivision with RemaindersRemainders and Quotients in DivisionDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueReading and Writing DecimalsComparing and Ordering DecimalsAdding and Subtracting DecimalsMultiplying DecimalsDividing DecimalsDividing FractionsMixed Number ArithmeticOrder of OperationsInteger Order of OperationsVariable ExpressionsCombining Like TermsOne-Step EquationsTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesAngle Pairs: Complementary, Supplementary, and VerticalParallel Lines and TransversalsCorresponding AnglesAlternate Interior AnglesTriangle Angle Sum TheoremExterior Angle TheoremTriangle Inequality TheoremSimilar Triangles: AA SimilaritySimilar Triangles: SSS and SAS SimilarityProportions in Similar TrianglesRight Triangle Trigonometry IntroductionTrigonometric Ratios ReviewRadian MeasureConverting Between Degrees and RadiansThe Unit CircleGraphing Sine and CosineGraphing Tangent and Reciprocal Trigonometric FunctionsDerivatives of Trigonometric FunctionsAntiderivativesIterated Integrals and Fubini's TheoremDouble Integrals in Cartesian CoordinatesDouble Integrals over Rectangular RegionsDouble Integrals in Polar CoordinatesDouble Integrals: Definition and SetupIterated Integrals and Fubini's TheoremDouble Integrals over Rectangular RegionsDouble Integrals over General RegionsApplications of Double Integrals: Area, Mass, and MomentsTriple Integrals in Cartesian CoordinatesTriple Integrals in Cylindrical and Spherical CoordinatesChange of Variables and the Jacobian DeterminantApplications of Triple Integrals: Volume and MassVector Fields and Their RepresentationsLine Integrals of Vector FieldsGreen's TheoremSurface Integrals and Flux of Vector FieldsSurface Integrals and Flux of Vector FieldsDivergence Theorem: Flux and OutflowDivergence TheoremElectric FluxGauss's LawConductors in Electrostatic EquilibriumCapacitance and CapacitorsDielectricsDielectric Constant and Relative PermittivityElectric Field Inside Dielectric MaterialsDielectric Materials and PolarizationDielectric Susceptibility and PermittivityEnergy Density in Electric FieldsElectric Current and Current DensityElectrical Resistance and ResistivityOhm's Law and Circuit ElementsElectromotive Force (EMF) and BatteriesKirchhoff's Circuit Laws: Voltage and CurrentDC Circuit Network Analysis MethodsTransient Response in RC CircuitsRC CircuitsLC and RLC CircuitsAC Circuits: FundamentalsImpedance and ReactanceAC Power and ResonanceElectromagnetic WavesThe Electromagnetic SpectrumBlackbody Radiation and Planck's LawPhotoelectric EffectThe Photon: Light as QuantaCompton ScatteringWave-Particle Dualityde Broglie WavelengthHeisenberg Uncertainty PrincipleWavefunction and the Born RuleThe Schrödinger EquationState Vectors and WavefunctionsQuantum SuperpositionQuantum EntanglementBell Theorem and Bell InequalitiesPostulates of Quantum MechanicsScattering TheoryIntroduction to Scattering TheoryPartial Wave Analysis in ScatteringSpin Angular MomentumElectron Spin and Intrinsic Magnetic MomentStern-Gerlach Experiment: Spin Quantization and MeasurementElectron Diffraction and Matter Wave PropertiesDavisson-Germer Experiment: Crystal Diffraction of ElectronsElectron Diffraction and Matter Wave InterferenceWavefunctions and Probability Density InterpretationQuantum Superposition and Linear Combinations of StatesQuantum Operators and ObservablesCanonical Commutation Relations and UncertaintyHeisenberg Uncertainty Principle and Measurement LimitsTime-Independent Schrödinger Equation and EigenvaluesHydrogen Atom in Quantum MechanicsSpectral Lines and Energy TransitionsSelection Rules for Atomic TransitionsLS and jj Coupling Schemes in Multi-Electron AtomsPauli Exclusion Principle and Antisymmetric WavefunctionsElectron Configuration and the Aufbau PrincipleThe Periodic Table and Atomic Electronic StructureThe Periodic TableElectron ConfigurationPeriodic TrendsIonization EnergyIonic BondingLewis StructuresResonance Structures and Delocalized ElectronsResonance and Formal ChargeMolecular Polarity and Dipole MomentsIntermolecular ForcesStates of Matter and Phase Changes: Melting, Boiling, and SublimationGas Laws and the Ideal Gas EquationGas Stoichiometry and Volume-Volume CalculationsThermochemistry and EnthalpyHeat Capacity and CalorimetryEntropy and Molecular DisorderSpontaneity and ΔGEntropy and Gibbs Free EnergyChemical EquilibriumChemical KineticsRate Law DeterminationEnzyme KineticsCell Cycle Regulation and CheckpointsMitosisCytokinesisMeiosisChromosomal Theory of InheritanceMendelian GeneticsDominance, Recessiveness, and Allelic InteractionsSex-Linked InheritanceNon-Mendelian Inheritance PatternsPopulation Genetics and Hardy-Weinberg EquilibriumNatural SelectionAdaptation and FitnessLife History Strategies: r- and K-SelectionPredator-Prey Dynamics and the Lotka-Volterra ModelCommunity Ecology: Structure and OrganizationMicrobial Ecology OverviewHuman MicrobiomeEmerging Infectious DiseasesInfectious Disease Surveillance SystemsOutbreak InvestigationEpidemic Curve Interpretation and Outbreak AnalysisTemporal Clustering and Seasonality AnalysisInterrupted Time Series DesignNatural Experiments and Quasi-Experimental Design

Longest path: 192 steps · 1047 total prerequisite topics

Prerequisites (3)

Leads To (3)