Difference-in-Differences Analysis

Research Depth 192 in the knowledge graph I know this Set as goal
Unlocks 6 downstream topics
quasi-experimental policy-evaluation temporal-analysis

Core Idea

Difference-in-differences (DiD) compares changes over time between exposed and unexposed groups, differencing out time-invariant confounding. If pre-exposure trends are parallel, DiD estimates the causal effect of a policy or intervention. DiD generalizes to multiple time periods and accommodates time-varying confounders unaffected by the intervention.

Explainer

You know from your study of natural experiments that some real-world events create exposure variation that is not determined by individual choice — a policy rollout that affects some states but not others, a factory closure in one town, a sudden price change. These events give researchers leverage to estimate causal effects without randomized assignment. Difference-in-differences (DiD) is the statistical technique that formalizes this leverage into an estimator.

The logic of DiD is easiest to grasp through a concrete example. Suppose a new smoking cessation program is introduced in California in 2015, but not in Nevada. You observe lung cancer incidence in both states from 2010 to 2020. Naively, you might compare post-2015 lung cancer rates in California to Nevada — but California might have had lower rates to begin with, biasing the comparison. Instead, DiD asks: how much did California's rate *change* relative to Nevada's rate? If California's incidence dropped by 8 per 100,000 between 2010–2015 and 2015–2020, while Nevada's dropped by 3 per 100,000 over the same period, the DiD estimate is 8 − 3 = 5 per 100,000, the excess reduction attributable to the program.

More formally, the estimator is: DiD = (Exposed post − Exposed pre) − (Unexposed post − Unexposed pre). The first difference removes time-invariant differences between California and Nevada (perhaps California always had lower smoking rates). The second differencing removes secular trends affecting both states equally (perhaps incidence was falling nationally due to improved treatment). What remains — the *difference in the differences* — isolates the variation attributable to the intervention.

The key assumption is parallel trends: in the absence of the intervention, both groups would have followed the same trajectory. This is not testable for the post-period (counterfactual), but it can be assessed by examining pre-intervention trends. If California and Nevada had similar trends from 2010 to 2015 before the program was introduced, the parallel trends assumption is more credible. A visual plot of pre-period trends is the standard diagnostic. When pre-trends diverge, DiD estimates are biased, because the trend difference itself would have produced outcome differences even without any intervention.

DiD generalizes powerfully. With panel data across many states and multiple years, DiD estimates are implemented via regression models with entity fixed effects (removing time-invariant confounders for each state) and time fixed effects (removing common temporal trends). This two-way fixed-effects design is the workhorse of policy evaluation in economics and epidemiology. More recent methodological work has complicated this picture — showing that when treatment timing is staggered across units, two-way FE estimators can produce distorted estimates if treatment effects evolve over time — leading to newer "heterogeneity-robust" DiD estimators. Understanding the classical DiD framework first gives you the conceptual foundation to follow and apply these refinements.

Practice Questions 5 questions

Prerequisite Chain

Counting to 10Counting to 20Understanding ZeroThe Number ZeroCounting to FiveOne-to-One CorrespondenceCombining Small Groups Within 5Addition Within 10Addition Within 20Two-Digit Addition Without RegroupingTwo-Digit Addition with RegroupingAddition Within 100Repeated Addition as MultiplicationMultiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Two-Digit by One-Digit DivisionDivision with RemaindersRemainders and Quotients in DivisionDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueReading and Writing DecimalsComparing and Ordering DecimalsAdding and Subtracting DecimalsMultiplying DecimalsDividing DecimalsDividing FractionsMixed Number ArithmeticOrder of OperationsInteger Order of OperationsVariable ExpressionsCombining Like TermsOne-Step EquationsTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesAngle Pairs: Complementary, Supplementary, and VerticalParallel Lines and TransversalsCorresponding AnglesAlternate Interior AnglesTriangle Angle Sum TheoremExterior Angle TheoremTriangle Inequality TheoremSimilar Triangles: AA SimilaritySimilar Triangles: SSS and SAS SimilarityProportions in Similar TrianglesRight Triangle Trigonometry IntroductionTrigonometric Ratios ReviewRadian MeasureConverting Between Degrees and RadiansThe Unit CircleGraphing Sine and CosineGraphing Tangent and Reciprocal Trigonometric FunctionsDerivatives of Trigonometric FunctionsAntiderivativesIterated Integrals and Fubini's TheoremDouble Integrals in Cartesian CoordinatesDouble Integrals over Rectangular RegionsDouble Integrals in Polar CoordinatesDouble Integrals: Definition and SetupIterated Integrals and Fubini's TheoremDouble Integrals over Rectangular RegionsDouble Integrals over General RegionsApplications of Double Integrals: Area, Mass, and MomentsTriple Integrals in Cartesian CoordinatesTriple Integrals in Cylindrical and Spherical CoordinatesChange of Variables and the Jacobian DeterminantApplications of Triple Integrals: Volume and MassVector Fields and Their RepresentationsLine Integrals of Vector FieldsGreen's TheoremSurface Integrals and Flux of Vector FieldsSurface Integrals and Flux of Vector FieldsDivergence Theorem: Flux and OutflowDivergence TheoremElectric FluxGauss's LawConductors in Electrostatic EquilibriumCapacitance and CapacitorsDielectricsDielectric Constant and Relative PermittivityElectric Field Inside Dielectric MaterialsDielectric Materials and PolarizationDielectric Susceptibility and PermittivityEnergy Density in Electric FieldsElectric Current and Current DensityElectrical Resistance and ResistivityOhm's Law and Circuit ElementsElectromotive Force (EMF) and BatteriesKirchhoff's Circuit Laws: Voltage and CurrentDC Circuit Network Analysis MethodsTransient Response in RC CircuitsRC CircuitsLC and RLC CircuitsAC Circuits: FundamentalsImpedance and ReactanceAC Power and ResonanceElectromagnetic WavesThe Electromagnetic SpectrumBlackbody Radiation and Planck's LawPhotoelectric EffectThe Photon: Light as QuantaCompton ScatteringWave-Particle Dualityde Broglie WavelengthHeisenberg Uncertainty PrincipleWavefunction and the Born RuleThe Schrödinger EquationState Vectors and WavefunctionsQuantum SuperpositionQuantum EntanglementBell Theorem and Bell InequalitiesPostulates of Quantum MechanicsScattering TheoryIntroduction to Scattering TheoryPartial Wave Analysis in ScatteringSpin Angular MomentumElectron Spin and Intrinsic Magnetic MomentStern-Gerlach Experiment: Spin Quantization and MeasurementElectron Diffraction and Matter Wave PropertiesDavisson-Germer Experiment: Crystal Diffraction of ElectronsElectron Diffraction and Matter Wave InterferenceWavefunctions and Probability Density InterpretationQuantum Superposition and Linear Combinations of StatesQuantum Operators and ObservablesCanonical Commutation Relations and UncertaintyHeisenberg Uncertainty Principle and Measurement LimitsTime-Independent Schrödinger Equation and EigenvaluesHydrogen Atom in Quantum MechanicsSpectral Lines and Energy TransitionsSelection Rules for Atomic TransitionsLS and jj Coupling Schemes in Multi-Electron AtomsPauli Exclusion Principle and Antisymmetric WavefunctionsElectron Configuration and the Aufbau PrincipleThe Periodic Table and Atomic Electronic StructureThe Periodic TableElectron ConfigurationPeriodic TrendsIonization EnergyIonic BondingLewis StructuresResonance Structures and Delocalized ElectronsResonance and Formal ChargeMolecular Polarity and Dipole MomentsIntermolecular ForcesStates of Matter and Phase Changes: Melting, Boiling, and SublimationGas Laws and the Ideal Gas EquationGas Stoichiometry and Volume-Volume CalculationsThermochemistry and EnthalpyHeat Capacity and CalorimetryEntropy and Molecular DisorderSpontaneity and ΔGEntropy and Gibbs Free EnergyChemical EquilibriumChemical KineticsRate Law DeterminationEnzyme KineticsCell Cycle Regulation and CheckpointsMitosisCytokinesisMeiosisChromosomal Theory of InheritanceMendelian GeneticsDominance, Recessiveness, and Allelic InteractionsSex-Linked InheritanceNon-Mendelian Inheritance PatternsPopulation Genetics and Hardy-Weinberg EquilibriumNatural SelectionAdaptation and FitnessLife History Strategies: r- and K-SelectionPredator-Prey Dynamics and the Lotka-Volterra ModelCommunity Ecology: Structure and OrganizationMicrobial Ecology OverviewHuman MicrobiomeEmerging Infectious DiseasesInfectious Disease Surveillance SystemsOutbreak InvestigationEpidemic Curve Interpretation and Outbreak AnalysisTemporal Clustering and Seasonality AnalysisInterrupted Time Series DesignNatural Experiments and Quasi-Experimental DesignDifference-in-Differences Analysis

Longest path: 193 steps · 1048 total prerequisite topics

Prerequisites (2)

Leads To (1)