A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Internal Validity and Threats to Causal Inference

College Depth 102 in the knowledge graph ☐ I know this ☆ Set as goal
78topics build on this
519prerequisites beneath it
See this on the map →
Experimental Research DesignConfounding Variables and Internal Validity→→External Validity and Generalization of Findings
validity causality confounds

Core Idea

Internal validity is the degree to which you can confidently conclude that changes in the dependent variable are caused by the independent variable rather than other factors. Major threats include history, maturation, testing effects, instrumentation, selection bias, and regression to the mean. Experimental designs with random assignment provide strongest internal validity; quasi-experimental and observational designs require systematic threat identification and control.

How It's Best Learned

For each potential threat (history, maturation, testing, instrumentation, selection, regression, interactions), identify how your design eliminates or controls it. Compare internal validity across designs: true experiment > quasi-experiment > correlational study. Read published critiques of studies to see how researchers address alternative explanations.

Common Misconceptions

Explainer

From your study of experimental research design, you know that the defining feature of a true experiment is random assignment — and you know it's important. Internal validity explains why. Internal validity is the degree to which you can make a confident causal claim: did the independent variable actually cause the change in the dependent variable, or could something else explain it? Every threat to internal validity is a plausible alternative explanation that, if present, undermines the causal conclusion. You can think of threats as rival hypotheses competing with your treatment explanation.

The major threats identified by Campbell and Stanley fall into recognizable categories. History refers to events that occur during a study — between pretest and posttest — that might cause change independent of the treatment. If a stress-reduction intervention runs during final exams week, the observed changes in stress could reflect the exam period ending, not the treatment. Maturation refers to natural developmental or biological changes over time: participants grow older, get tired, get better on their own. A learning intervention with children over a school year competes with the maturation of reading skills. Testing effects occur when taking the pretest itself changes performance on the posttest — practice effects, sensitization, or learning the measure. Instrumentation occurs when the measurement tool or the raters change over the course of the study, creating apparent change that is really a measurement artifact.

Selection bias and regression to the mean are particularly important in quasi-experimental designs. Selection bias arises when comparison groups differ on relevant characteristics before the study begins — the groups were not equivalent to start with, so any difference at the end could reflect pre-existing differences rather than the treatment. Regression to the mean is a statistical phenomenon: if you select participants because they scored extremely high or low on a pretest, their posttest scores will tend to drift back toward the population mean regardless of any intervention, because extreme scores partly reflect measurement error. Treating this drift as a treatment effect is a classic error in studies targeting "at-risk" populations.

Random assignment is the most powerful safeguard against these threats because it distributes all known and unknown confounds equally across conditions on average — including ones the researcher never thought to measure. But it doesn't eliminate every threat. A long study with random assignment still faces history and maturation; a study using pretests faces testing effects. The value of understanding specific threats is that it guides design choices: adding a no-treatment control group addresses history and maturation; using a posttest-only design eliminates testing effects; using masked raters addresses instrumentation drift. Strong experimental design is the systematic removal of alternative explanations before data collection begins.

Practice Questions 5 questions

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Number Bonds to 10 → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Dividing Integers → Unit Rates → Proportions → Percent Concept → Converting Between Fractions, Decimals, and Percents → Operations with Rational Numbers → Two-Step Equations → Solving Multi-Step Equations → Equations with Variables on Both Sides → Angle Pairs: Complementary, Supplementary, and Vertical → Parallel Lines and Transversals → Corresponding Angles → Alternate Interior Angles → Triangle Angle Sum Theorem → Exterior Angle Theorem → Triangle Inequality Theorem → Similar Triangles: AA Similarity → Similar Triangles: SSS and SAS Similarity → Proportions in Similar Triangles → Right Triangle Trigonometry Introduction → Sine, Cosine, and Tangent Ratios → Trigonometric Ratios Review → Radian Measure → Converting Between Degrees and Radians → The Unit Circle → Graphing Sine and Cosine → Graphing Tangent and Reciprocal Trigonometric Functions → Derivatives of Trigonometric Functions → Antiderivatives → Indefinite Integrals → Basic Integration Rules → Riemann Sums → Definite Integral Definition → Probability Density Functions and Continuous Distributions → Cumulative Distribution Functions → Continuous Random Variables → Probability Density Functions → Expected Value → Weak Law of Large Numbers → Probability Axioms and Rules → Conditional Probability → Conditional Distributions → Bivariate Normal Distribution → Normal Distribution → Standard Normal Distribution and Z-Scores → Hypothesis Testing Fundamentals → Experimental Research Design → Control and Experimental Groups → Random Assignment → Confounding Variables and Internal Validity → Internal Validity and Threats to Causal Inference

Longest path: 103 steps · 519 total prerequisite topics

Prerequisites (2)

Leads To (1)