A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Research Integrity and Open Science: Transparency and Reproducibility

College Depth 111 in the knowledge graph ☐ I know this ☆ Set as goal
4topics build on this
649prerequisites beneath it
See this on the map →
Research Ethics: Human Subjects Protection→→Bayesian Methods in Social ScienceMachine Learning Applications in Social Science
research-integrity open-science reproducibility preregistration

Core Idea

Research integrity requires transparency about methods, data, and decisions. Open science practices—preregistration, data sharing, code availability—reduce researcher degrees of freedom and enable replication. Social science faces a reproducibility challenge; transparency improves reliability.

Explainer

Your prerequisite introduced research ethics in the context of human subjects — the rules that protect participants from harm. This topic addresses a different dimension of integrity: not participant harm but the reliability of scientific knowledge itself. The social sciences experienced what is now called the replication crisis: a series of high-profile failures when influential findings could not be reproduced by independent researchers. A 2015 project attempted to replicate 100 psychology studies and found that only about 36–39% produced significant results in the same direction. This is not primarily a story about fraud — it is a story about structural features of the research process that systematically inflate false-positive findings.

The key concept is researcher degrees of freedom — the many legitimate-seeming choices a researcher makes during data collection, processing, and analysis that can, consciously or not, be steered toward significant results. When to stop collecting data, which participants to exclude, which covariates to include, which of several plausible dependent variable operationalizations to use — each choice creates a fork. With enough forks, a researcher can almost always find a path to p < .05 even in the absence of a real effect. This is sometimes called p-hacking when intentional, but the same outcome arises from unconscious motivated reasoning. The research literature accumulates false positives because journals preferentially publish significant results (publication bias), so the non-significant replications that never get submitted are invisible.

Preregistration is the primary structural solution. Before collecting data, a researcher publicly registers their hypotheses, sample size, exclusion criteria, and analysis plan in a time-stamped repository (such as AsPredicted or OSF). This creates a clean separation between confirmatory analysis (testing the pre-specified hypothesis) and exploratory analysis (discovering patterns not anticipated in advance). Both are legitimate, but they have different inferential status: an exploratory finding requires replication before it is treated as confirmed. Preregistration does not eliminate researcher flexibility — it makes it transparent, allowing readers to evaluate which choices were made in advance versus post-hoc.

Open data and open code address the complementary problem of reproducibility. When data and analysis scripts are published alongside findings, other researchers can reproduce the exact results, catch errors, and run alternative analyses. This standard — increasingly required by journals and funders — represents a shift from "trust the author" to "verify the analysis." The infrastructure for this (GitHub, OSF, Zenodo) now makes sharing cheap; the main barriers are cultural and incentive-based. A researcher who shares imperfect data faces scrutiny they might avoid by not sharing; changing these incentives requires field-level norm change, not just individual virtue. Understanding these structural dynamics is what distinguishes integrity as a systems problem from integrity as a personal ethics problem.

What did you take from this?

Topics in reflective domains aren't scored by quiz answers. Read, reflect, and mark when you've thought it through.

Quiz me anyway →

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Number Bonds to 10 → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Introduction to Exponents → Order of Operations → Integer Order of Operations → Variable Expressions → The Distributive Property → Variables and Expressions Review → Introduction to Polynomials → Adding and Subtracting Polynomials → Multiplying Polynomials → Factorial → Permutations → Combinations → Counting Principles: Addition and Multiplication Rules → Introduction to Graph Theory → Propositional Logic Foundations → Logical Equivalences → Boolean Algebra → Introduction to Propositional Logic → Introduction to Predicate Logic (First-Order Logic) → First-Order Logic Syntax → Terms and Atomic Formulas in FOL → Variable Binding and Scope → Open and Closed Formulas in First-Order Logic → Variable Substitution and Capture-Avoidance in First-Order Logic → Quantifier Instantiation Rules in First-Order Proof Systems → Universal Quantification: Meaning and Scope → Free Variables and Bound Variables → Substitution and Instantiation in Predicate Logic → Terms and Atomic Formulas → Formulas and Well-Formed Expressions → Structures and Interpretations → Model Interpretation and Satisfaction → Interpretation, Truth, and Satisfaction of Formulas → Logical Consequence and Entailment → Soundness Theorem and Validity of Proof Systems → Deductive Reasoning and Formal Proof Systems → First-Order Resolution → Propositional Resolution → Semantic Tableaux (Propositional) → Semantic Tableaux (First-Order) → Decidable Fragments of First-Order Logic → Gödel's Completeness Theorem for First-Order Logic → Gödel's Incompleteness Theorems → Introduction to Intuitionistic Logic → Introduction to Modal Logic → Compatibilism → Moral Responsibility → Moral Psychology → Moral Sentiments and Emotions → Care Ethics → Rational Choice and Ethics → Contractarian Moral Foundations → Moral Foundations and Intuitions → Moral Relativism → Introduction to Applied Ethics → Bioethics: Foundations → Medical Ethics & Patient Autonomy → Informed Consent & Research Ethics → Research Ethics: Human Subjects Protection → Research Integrity and Open Science: Transparency and Reproducibility

Longest path: 112 steps · 649 total prerequisite topics

Prerequisites (1)

Leads To (2)