A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

External Validity and Generalization of Findings

College Depth 103 in the knowledge graph ☐ I know this ☆ Set as goal
77topics build on this
520prerequisites beneath it
See this on the map →
Internal Validity and Threats to Causal InferenceSampling and Populations in Psychological Research→→Construct Validity and Measurement ValidityExternal Validity and Generalizability to Populations
validity generalization external

Core Idea

External validity is the degree to which findings generalize beyond the specific participants, settings, and times studied. Laboratory experiments with convenience samples and artificial tasks often have lower external validity than naturalistic or community-based studies. Balancing internal and external validity requires strategic trade-offs: tight experimental control strengthens causal inference but may reduce applicability to real-world contexts.

Explainer

Your prerequisite on internal validity established that a study has internal validity when its design supports a causal inference — when we can attribute the observed outcome to the manipulated variable rather than to confounds. But internal validity only answers "did X cause Y in this study?" External validity asks the harder follow-up: "so what?" — meaning, does the causal relationship found here hold in other places, with other people, at other times? A study can be perfectly internally valid and almost completely non-generalizable, and the history of psychology is full of cautionary examples.

There are three main threats to external validity. Population validity concerns whether findings generalize from the sample studied to other people. Psychology's most-criticized sampling problem is the WEIRD sample — participants from Western, Educated, Industrialized, Rich, and Democratic societies, often undergraduate students at research universities. Findings from such samples have repeatedly failed to replicate with different populations: the Mueller-Lyer illusion varies across cultures; conformity effects vary by individualist vs. collectivist contexts; even basic memory and perception phenomena show cross-cultural differences. Ecological validity concerns whether the laboratory setting captures the phenomenon as it operates in the real world. A memory study using lists of unrelated words is internally clean but may tell us little about how people remember personally meaningful events. Temporal validity concerns whether findings hold across time — social norms, technology, and cultural contexts change, and phenomena studied in one era may not replicate in another.

The central tension in research design is that the moves that maximize internal validity often threaten external validity, and vice versa. Random assignment to conditions, strict experimental control, standardized stimuli, and laboratory settings all increase confidence in causal inference but introduce artificiality. Naturalistic observation and field research capture behavior in its real context but sacrifice control. This is not a problem with a clean solution — it is a design trade-off that researchers navigate based on the question being asked. If you want to know *whether* a drug can work, a tightly controlled randomized trial is appropriate. If you want to know *whether* it works as prescribed in real clinical practice, you need effectiveness research in natural settings.

Replication is the scientific community's primary tool for establishing external validity over time. A single study, no matter how well designed, makes a narrow generalization claim. A finding that holds across multiple labs, diverse participant populations, varied operationalizations of the key construct, and different cultural contexts is far more likely to reflect a genuine phenomenon. The reproducibility crisis in psychology (many classic findings failed direct replication in large-sample attempts) renewed attention to external validity as distinct from internal validity — and reminded the field that p < .05 in one well-controlled study is only the beginning of the evidential story.

Practice Questions 5 questions

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Number Bonds to 10 → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Dividing Integers → Unit Rates → Proportions → Percent Concept → Converting Between Fractions, Decimals, and Percents → Operations with Rational Numbers → Two-Step Equations → Solving Multi-Step Equations → Equations with Variables on Both Sides → Angle Pairs: Complementary, Supplementary, and Vertical → Parallel Lines and Transversals → Corresponding Angles → Alternate Interior Angles → Triangle Angle Sum Theorem → Exterior Angle Theorem → Triangle Inequality Theorem → Similar Triangles: AA Similarity → Similar Triangles: SSS and SAS Similarity → Proportions in Similar Triangles → Right Triangle Trigonometry Introduction → Sine, Cosine, and Tangent Ratios → Trigonometric Ratios Review → Radian Measure → Converting Between Degrees and Radians → The Unit Circle → Graphing Sine and Cosine → Graphing Tangent and Reciprocal Trigonometric Functions → Derivatives of Trigonometric Functions → Antiderivatives → Indefinite Integrals → Basic Integration Rules → Riemann Sums → Definite Integral Definition → Probability Density Functions and Continuous Distributions → Cumulative Distribution Functions → Continuous Random Variables → Probability Density Functions → Expected Value → Weak Law of Large Numbers → Probability Axioms and Rules → Conditional Probability → Conditional Distributions → Bivariate Normal Distribution → Normal Distribution → Standard Normal Distribution and Z-Scores → Hypothesis Testing Fundamentals → Experimental Research Design → Control and Experimental Groups → Random Assignment → Confounding Variables and Internal Validity → Internal Validity and Threats to Causal Inference → External Validity and Generalization of Findings

Longest path: 104 steps · 520 total prerequisite topics

Prerequisites (2)

Leads To (2)