A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Research Integrity and Open Science: Transparency and Reproducibility

College Depth 111 in the knowledge graph I know this Set as goal
4topics build on this
649prerequisites beneath it
See this on the map →
Research Ethics: Human Subjects ProtectionBayesian Methods in Social ScienceMachine Learning Applications in Social Science
research-integrity open-science reproducibility preregistration

Core Idea

Research integrity requires transparency about methods, data, and decisions. Open science practices—preregistration, data sharing, code availability—reduce researcher degrees of freedom and enable replication. Social science faces a reproducibility challenge; transparency improves reliability.

Explainer

Your prerequisite introduced research ethics in the context of human subjects — the rules that protect participants from harm. This topic addresses a different dimension of integrity: not participant harm but the reliability of scientific knowledge itself. The social sciences experienced what is now called the replication crisis: a series of high-profile failures when influential findings could not be reproduced by independent researchers. A 2015 project attempted to replicate 100 psychology studies and found that only about 36–39% produced significant results in the same direction. This is not primarily a story about fraud — it is a story about structural features of the research process that systematically inflate false-positive findings.

The key concept is researcher degrees of freedom — the many legitimate-seeming choices a researcher makes during data collection, processing, and analysis that can, consciously or not, be steered toward significant results. When to stop collecting data, which participants to exclude, which covariates to include, which of several plausible dependent variable operationalizations to use — each choice creates a fork. With enough forks, a researcher can almost always find a path to p < .05 even in the absence of a real effect. This is sometimes called p-hacking when intentional, but the same outcome arises from unconscious motivated reasoning. The research literature accumulates false positives because journals preferentially publish significant results (publication bias), so the non-significant replications that never get submitted are invisible.

Preregistration is the primary structural solution. Before collecting data, a researcher publicly registers their hypotheses, sample size, exclusion criteria, and analysis plan in a time-stamped repository (such as AsPredicted or OSF). This creates a clean separation between confirmatory analysis (testing the pre-specified hypothesis) and exploratory analysis (discovering patterns not anticipated in advance). Both are legitimate, but they have different inferential status: an exploratory finding requires replication before it is treated as confirmed. Preregistration does not eliminate researcher flexibility — it makes it transparent, allowing readers to evaluate which choices were made in advance versus post-hoc.

Open data and open code address the complementary problem of reproducibility. When data and analysis scripts are published alongside findings, other researchers can reproduce the exact results, catch errors, and run alternative analyses. This standard — increasingly required by journals and funders — represents a shift from "trust the author" to "verify the analysis." The infrastructure for this (GitHub, OSF, Zenodo) now makes sharing cheap; the main barriers are cultural and incentive-based. A researcher who shares imperfect data faces scrutiny they might avoid by not sharing; changing these incentives requires field-level norm change, not just individual virtue. Understanding these structural dynamics is what distinguishes integrity as a systems problem from integrity as a personal ethics problem.

What did you take from this?

Topics in reflective domains aren't scored by quiz answers. Read, reflect, and mark when you've thought it through.

Quiz me anyway →

Prerequisite Chain

Understanding ZeroThe Number ZeroCounting to FiveCounting to 10Counting to 20Counting a Set of Objects Up to 20Cardinality: The Last Number CountedMatching Numerals to QuantitiesSubitizing Small QuantitiesAddition Within 10Number Bonds to 10Addition Within 20Doubles and Near DoublesDoubles Facts Within 10Near Doubles Facts Within 20Mental Math Strategies for AdditionMental Math: Adding and Subtracting TensAddition Within 100Repeated Addition as MultiplicationMultiplication as Equal GroupsMultiplication: ArraysBasic Multiplication Facts (0s, 1s, 2s, 5s, 10s)Multiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Multiplication and Division Fact FamiliesRelationship Between Multiplication and DivisionDivision Facts as Inverse of MultiplicationRemainders and Quotients in DivisionDivision Word ProblemsMulti-Step Word ProblemsSolving Multi-Step Word ProblemsMultiplication Word ProblemsDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueIntegers and the Number LineComparing and Ordering IntegersAbsolute ValueAdding IntegersSubtracting IntegersMultiplying IntegersIntroduction to ExponentsOrder of OperationsInteger Order of OperationsVariable ExpressionsThe Distributive PropertyVariables and Expressions ReviewIntroduction to PolynomialsAdding and Subtracting PolynomialsMultiplying PolynomialsFactorialPermutationsCombinationsCounting Principles: Addition and Multiplication RulesIntroduction to Graph TheoryPropositional Logic FoundationsLogical EquivalencesBoolean AlgebraIntroduction to Propositional LogicIntroduction to Predicate Logic (First-Order Logic)First-Order Logic SyntaxTerms and Atomic Formulas in FOLVariable Binding and ScopeOpen and Closed Formulas in First-Order LogicVariable Substitution and Capture-Avoidance in First-Order LogicQuantifier Instantiation Rules in First-Order Proof SystemsUniversal Quantification: Meaning and ScopeFree Variables and Bound VariablesSubstitution and Instantiation in Predicate LogicTerms and Atomic FormulasFormulas and Well-Formed ExpressionsStructures and InterpretationsModel Interpretation and SatisfactionInterpretation, Truth, and Satisfaction of FormulasLogical Consequence and EntailmentSoundness Theorem and Validity of Proof SystemsDeductive Reasoning and Formal Proof SystemsFirst-Order ResolutionPropositional ResolutionSemantic Tableaux (Propositional)Semantic Tableaux (First-Order)Decidable Fragments of First-Order LogicGödel's Completeness Theorem for First-Order LogicGödel's Incompleteness TheoremsIntroduction to Intuitionistic LogicIntroduction to Modal LogicCompatibilismMoral ResponsibilityMoral PsychologyMoral Sentiments and EmotionsCare EthicsRational Choice and EthicsContractarian Moral FoundationsMoral Foundations and IntuitionsMoral RelativismIntroduction to Applied EthicsBioethics: FoundationsMedical Ethics & Patient AutonomyInformed Consent & Research EthicsResearch Ethics: Human Subjects ProtectionResearch Integrity and Open Science: Transparency and Reproducibility

Longest path: 112 steps · 649 total prerequisite topics

Prerequisites (1)

Leads To (2)