A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Analysis Planning and Preregistration of Hypotheses

College Depth 109 in the knowledge graph ☐ I know this ☆ Set as goal
1topic build on this
549prerequisites beneath it
See this on the map →
Ethics in Psychological ResearchFormulating Research Questions with Specificity+1 more→→Preregistration and Research Transparency Planning
integrity transparency preregistration

Core Idea

Preregistration involves publicly specifying hypotheses, variables, design, and analytical approach before data collection, creating accountability and distinguishing confirmatory hypothesis tests from exploratory post-hoc analyses. Preregistration reduces researcher degrees of freedom (p-hacking) while enabling transparent exploration properly labeled as such. This practice improves reproducibility and protects against selective reporting.

Explainer

Your background in research ethics and research question formulation establishes what good research is supposed to be: a transparent test of a specific prediction. Preregistration is the mechanism that enforces that standard at the moment it is most vulnerable — when the researcher sits down with data and has countless small decisions to make.

The core problem is researcher degrees of freedom: the large number of legitimate-looking analytic choices that face a researcher after data are collected. Which participants to exclude? Which covariates to include? Which of several outcome measures to report as primary? Should you transform that skewed variable? When should you stop collecting data? Each choice seems defensible in isolation. But when every choice is made after observing how it affects the results — consciously or not — the researcher is no longer testing a hypothesis. They are searching the data for a pattern and then reporting it as if it were predicted. This process, known as p-hacking, inflates false positive rates far above the nominal 5% level. The replication crisis in psychology was in large part a consequence of widespread, often unconscious, researcher degrees of freedom.

Preregistration closes this loophole by requiring researchers to commit publicly — before data collection — to their hypotheses, primary variables, sample size, exclusion criteria, and analysis plan. The commitment is filed on a registry such as OSF (Open Science Framework), timestamped, and retrievable. When a paper is later published, readers and reviewers can inspect what was predicted in advance. Analyses that match the preregistered plan are confirmatory: they constitute a genuine hypothesis test with interpretable error rates. Analyses that deviate from or go beyond the plan are exploratory: they generate hypotheses for future study but do not confirm them.

The key clarification is that preregistration does not prohibit exploration — it requires that exploration be *labeled* as such. Curiosity and hypothesis generation are essential to science; the problem was never exploration itself, but presenting exploratory findings as confirmatory. A preregistered study that finds something unexpected in an unplanned analysis has discovered something interesting and worth pursuing — but that finding requires its own confirmatory test before it counts as established knowledge.

Practice Questions 5 questions

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Number Bonds to 10 → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Dividing Integers → Unit Rates → Proportions → Percent Concept → Converting Between Fractions, Decimals, and Percents → Operations with Rational Numbers → Two-Step Equations → Solving Multi-Step Equations → Equations with Variables on Both Sides → Angle Pairs: Complementary, Supplementary, and Vertical → Parallel Lines and Transversals → Corresponding Angles → Alternate Interior Angles → Triangle Angle Sum Theorem → Exterior Angle Theorem → Triangle Inequality Theorem → Similar Triangles: AA Similarity → Similar Triangles: SSS and SAS Similarity → Proportions in Similar Triangles → Right Triangle Trigonometry Introduction → Sine, Cosine, and Tangent Ratios → Trigonometric Ratios Review → Radian Measure → Converting Between Degrees and Radians → The Unit Circle → Graphing Sine and Cosine → Graphing Tangent and Reciprocal Trigonometric Functions → Derivatives of Trigonometric Functions → Antiderivatives → Indefinite Integrals → Basic Integration Rules → Riemann Sums → Definite Integral Definition → Probability Density Functions and Continuous Distributions → Cumulative Distribution Functions → Continuous Random Variables → Probability Density Functions → Expected Value → Weak Law of Large Numbers → Probability Axioms and Rules → Conditional Probability → Conditional Distributions → Bivariate Normal Distribution → Normal Distribution → Standard Normal Distribution and Z-Scores → Hypothesis Testing Fundamentals → Experimental Research Design → Control and Experimental Groups → Random Assignment → Confounding Variables and Internal Validity → Blinding and Demand Characteristics → Validity in Psychological Measurement → Inferential Statistics in Psychology → Effect Size and Statistical Power → Sample Size Determination in Research Planning → Literature Review and Research Synthesis → Hypothesis Construction: Directional and Nondirectional Predictions → Analysis Planning and Preregistration of Hypotheses

Longest path: 110 steps · 549 total prerequisite topics

Prerequisites (3)

Leads To (1)