A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Analysis Planning and Preregistration of Hypotheses

College Depth 109 in the knowledge graph I know this Set as goal
1topic build on this
549prerequisites beneath it
See this on the map →
Ethics in Psychological ResearchFormulating Research Questions with Specificity+1 morePreregistration and Research Transparency Planning
integrity transparency preregistration

Core Idea

Preregistration involves publicly specifying hypotheses, variables, design, and analytical approach before data collection, creating accountability and distinguishing confirmatory hypothesis tests from exploratory post-hoc analyses. Preregistration reduces researcher degrees of freedom (p-hacking) while enabling transparent exploration properly labeled as such. This practice improves reproducibility and protects against selective reporting.

Explainer

Your background in research ethics and research question formulation establishes what good research is supposed to be: a transparent test of a specific prediction. Preregistration is the mechanism that enforces that standard at the moment it is most vulnerable — when the researcher sits down with data and has countless small decisions to make.

The core problem is researcher degrees of freedom: the large number of legitimate-looking analytic choices that face a researcher after data are collected. Which participants to exclude? Which covariates to include? Which of several outcome measures to report as primary? Should you transform that skewed variable? When should you stop collecting data? Each choice seems defensible in isolation. But when every choice is made after observing how it affects the results — consciously or not — the researcher is no longer testing a hypothesis. They are searching the data for a pattern and then reporting it as if it were predicted. This process, known as p-hacking, inflates false positive rates far above the nominal 5% level. The replication crisis in psychology was in large part a consequence of widespread, often unconscious, researcher degrees of freedom.

Preregistration closes this loophole by requiring researchers to commit publicly — before data collection — to their hypotheses, primary variables, sample size, exclusion criteria, and analysis plan. The commitment is filed on a registry such as OSF (Open Science Framework), timestamped, and retrievable. When a paper is later published, readers and reviewers can inspect what was predicted in advance. Analyses that match the preregistered plan are confirmatory: they constitute a genuine hypothesis test with interpretable error rates. Analyses that deviate from or go beyond the plan are exploratory: they generate hypotheses for future study but do not confirm them.

The key clarification is that preregistration does not prohibit exploration — it requires that exploration be *labeled* as such. Curiosity and hypothesis generation are essential to science; the problem was never exploration itself, but presenting exploratory findings as confirmatory. A preregistered study that finds something unexpected in an unplanned analysis has discovered something interesting and worth pursuing — but that finding requires its own confirmatory test before it counts as established knowledge.

Practice Questions 5 questions

Prerequisite Chain

Understanding ZeroThe Number ZeroCounting to FiveCounting to 10Counting to 20Counting a Set of Objects Up to 20Cardinality: The Last Number CountedMatching Numerals to QuantitiesSubitizing Small QuantitiesAddition Within 10Number Bonds to 10Addition Within 20Doubles and Near DoublesDoubles Facts Within 10Near Doubles Facts Within 20Mental Math Strategies for AdditionMental Math: Adding and Subtracting TensAddition Within 100Repeated Addition as MultiplicationMultiplication as Equal GroupsMultiplication: ArraysBasic Multiplication Facts (0s, 1s, 2s, 5s, 10s)Multiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Multiplication and Division Fact FamiliesRelationship Between Multiplication and DivisionDivision Facts as Inverse of MultiplicationRemainders and Quotients in DivisionDivision Word ProblemsMulti-Step Word ProblemsSolving Multi-Step Word ProblemsMultiplication Word ProblemsDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueIntegers and the Number LineComparing and Ordering IntegersAbsolute ValueAdding IntegersSubtracting IntegersMultiplying IntegersDividing IntegersUnit RatesProportionsPercent ConceptConverting Between Fractions, Decimals, and PercentsOperations with Rational NumbersTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesAngle Pairs: Complementary, Supplementary, and VerticalParallel Lines and TransversalsCorresponding AnglesAlternate Interior AnglesTriangle Angle Sum TheoremExterior Angle TheoremTriangle Inequality TheoremSimilar Triangles: AA SimilaritySimilar Triangles: SSS and SAS SimilarityProportions in Similar TrianglesRight Triangle Trigonometry IntroductionSine, Cosine, and Tangent RatiosTrigonometric Ratios ReviewRadian MeasureConverting Between Degrees and RadiansThe Unit CircleGraphing Sine and CosineGraphing Tangent and Reciprocal Trigonometric FunctionsDerivatives of Trigonometric FunctionsAntiderivativesIndefinite IntegralsBasic Integration RulesRiemann SumsDefinite Integral DefinitionProbability Density Functions and Continuous DistributionsCumulative Distribution FunctionsContinuous Random VariablesProbability Density FunctionsExpected ValueWeak Law of Large NumbersProbability Axioms and RulesConditional ProbabilityConditional DistributionsBivariate Normal DistributionNormal DistributionStandard Normal Distribution and Z-ScoresHypothesis Testing FundamentalsExperimental Research DesignControl and Experimental GroupsRandom AssignmentConfounding Variables and Internal ValidityBlinding and Demand CharacteristicsValidity in Psychological MeasurementInferential Statistics in PsychologyEffect Size and Statistical PowerSample Size Determination in Research PlanningLiterature Review and Research SynthesisHypothesis Construction: Directional and Nondirectional PredictionsAnalysis Planning and Preregistration of Hypotheses

Longest path: 110 steps · 549 total prerequisite topics

Prerequisites (3)

Leads To (1)