Conservation of Expected Evidence

Graduate Depth 215 in the knowledge graph I know this Set as goal
Unlocks 2 downstream topics
bayesian evidence probability rationality

Core Idea

Before you observe evidence, your expected posterior probability must equal your prior probability — averaged over all possible observations, weighted by their likelihood. This means you cannot rationally expect to be convinced of something you do not already believe: if you expect the evidence to support hypothesis H, then you should already believe H more strongly. Conservation of expected evidence is a powerful diagnostic for motivated reasoning: if you expect to find evidence confirming your current belief no matter what happens, something has gone wrong with your reasoning. Genuine inquiry must admit the possibility that evidence will push you in either direction.

How It's Best Learned

Work through a concrete example: before flipping a coin you suspect is biased, write down how each possible sequence of outcomes would update your belief. Verify that the probability-weighted average of all possible posteriors equals your prior. Then apply this to real beliefs: before reading a study, ask what results would update you in each direction and by how much.

Common Misconceptions

Explainer

Conservation of expected evidence is a direct consequence of Bayes' theorem that serves as one of the most powerful diagnostic tools for detecting broken reasoning. The principle states: before you observe any evidence, the probability-weighted average of all your possible posterior beliefs must equal your current prior. Mathematically, this is just the law of total probability applied to belief updating, but its practical implications are profound.

Consider a concrete example. You suspect a coin might be biased toward heads. Before flipping it, you think through what each outcome would do to your belief. If heads comes up, you will update toward "biased." If tails comes up, you will update toward "fair." Now here is the key constraint: the amount you would update toward "biased" on heads, weighted by the probability of heads, must exactly equal the amount you would update toward "fair" on tails, weighted by the probability of tails. The expected net change in your belief is zero. This is not because evidence is useless -- once you actually flip the coin and see the result, you will genuinely update in one direction. The point is that you cannot predict in advance which direction you will update, on net, without that prediction itself being evidence you should have already incorporated.

This principle becomes a powerful diagnostic for motivated reasoning. Suppose a researcher says: "If the clinical trial shows positive results, I'll accept them. But if it shows negative results, I'll conclude the methodology was probably flawed." This person has pre-committed to updating upward on positive results and refusing to update downward on negative results. The probability-weighted average of their anticipated posteriors is higher than their prior -- which is mathematically impossible for correct Bayesian reasoning. They have violated conservation of expected evidence, and the violation reveals that they are not genuinely open to what the evidence might show. Their bottom line was already written.

The practical test you can apply to your own reasoning is simple: before examining evidence on any question, ask what results would push you in each direction, and by how much. If you find that every possible outcome would confirm your current belief -- or that disconfirming outcomes would always be explained away -- conservation of expected evidence is violated, and you are not reasoning honestly. Genuine inquiry must admit the possibility that the evidence will push you somewhere you did not want to go. This is uncomfortable, but it is the price of having beliefs that actually track reality rather than beliefs that merely feel good.

What did you take from this?

Topics in reflective domains aren't scored by quiz answers. Read, reflect, and mark when you've thought it through.

Quiz me anyway →

Prerequisite Chain

Counting to 10Counting to 20Understanding ZeroThe Number ZeroCounting to FiveOne-to-One CorrespondenceCombining Small Groups Within 5Addition Within 10Addition Within 20Two-Digit Addition Without RegroupingTwo-Digit Addition with RegroupingAddition Within 100Repeated Addition as MultiplicationMultiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Two-Digit by One-Digit DivisionDivision with RemaindersRemainders and Quotients in DivisionDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueIntegers and the Number LineComparing and Ordering IntegersAbsolute ValueAdding IntegersSubtracting IntegersMultiplying IntegersDividing IntegersUnit RatesProportionsPercent ConceptConverting Between Fractions, Decimals, and PercentsOperations with Rational NumbersTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesAngle Pairs: Complementary, Supplementary, and VerticalParallel Lines and TransversalsCorresponding AnglesAlternate Interior AnglesTriangle Angle Sum TheoremExterior Angle TheoremTriangle Inequality TheoremSimilar Triangles: AA SimilaritySimilar Triangles: SSS and SAS SimilarityProportions in Similar TrianglesRight Triangle Trigonometry IntroductionTrigonometric Ratios ReviewRadian MeasureConverting Between Degrees and RadiansThe Unit CircleGraphing Sine and CosineGraphing Tangent and Reciprocal Trigonometric FunctionsDerivatives of Trigonometric FunctionsAntiderivativesIterated Integrals and Fubini's TheoremDouble Integrals in Cartesian CoordinatesDouble Integrals over Rectangular RegionsDouble Integrals in Polar CoordinatesDouble Integrals: Definition and SetupIterated Integrals and Fubini's TheoremDouble Integrals over Rectangular RegionsDouble Integrals over General RegionsApplications of Double Integrals: Area, Mass, and MomentsTriple Integrals in Cartesian CoordinatesTriple Integrals in Cylindrical and Spherical CoordinatesChange of Variables and the Jacobian DeterminantApplications of Triple Integrals: Volume and MassVector Fields and Their RepresentationsLine Integrals of Vector FieldsGreen's TheoremSurface Integrals and Flux of Vector FieldsSurface Integrals and Flux of Vector FieldsDivergence Theorem: Flux and OutflowDivergence TheoremElectric FluxGauss's LawConductors in Electrostatic EquilibriumCapacitance and CapacitorsDielectricsDielectric Constant and Relative PermittivityElectric Field Inside Dielectric MaterialsDielectric Materials and PolarizationDielectric Susceptibility and PermittivityEnergy Density in Electric FieldsElectric Current and Current DensityElectrical Resistance and ResistivityOhm's Law and Circuit ElementsElectromotive Force (EMF) and BatteriesKirchhoff's Circuit Laws: Voltage and CurrentDC Circuit Network Analysis MethodsTransient Response in RC CircuitsRC CircuitsLC and RLC CircuitsAC Circuits: FundamentalsImpedance and ReactanceAC Power and ResonanceElectromagnetic WavesThe Electromagnetic SpectrumBlackbody Radiation and Planck's LawPhotoelectric EffectThe Photon: Light as QuantaCompton ScatteringWave-Particle Dualityde Broglie WavelengthHeisenberg Uncertainty PrincipleWavefunction and the Born RuleThe Schrödinger EquationState Vectors and WavefunctionsQuantum SuperpositionQuantum EntanglementBell Theorem and Bell InequalitiesPostulates of Quantum MechanicsScattering TheoryIntroduction to Scattering TheoryPartial Wave Analysis in ScatteringSpin Angular MomentumElectron Spin and Intrinsic Magnetic MomentStern-Gerlach Experiment: Spin Quantization and MeasurementElectron Diffraction and Matter Wave PropertiesDavisson-Germer Experiment: Crystal Diffraction of ElectronsElectron Diffraction and Matter Wave InterferenceWavefunctions and Probability Density InterpretationQuantum Superposition and Linear Combinations of StatesQuantum Operators and ObservablesCanonical Commutation Relations and UncertaintyHeisenberg Uncertainty Principle and Measurement LimitsTime-Independent Schrödinger Equation and EigenvaluesHydrogen Atom in Quantum MechanicsSpectral Lines and Energy TransitionsSelection Rules for Atomic TransitionsLS and jj Coupling Schemes in Multi-Electron AtomsPauli Exclusion Principle and Antisymmetric WavefunctionsElectron Configuration and the Aufbau PrincipleThe Periodic Table and Atomic Electronic StructureThe Periodic TableElectron ConfigurationPeriodic TrendsIonization EnergyIonic BondingLewis StructuresResonance Structures and Delocalized ElectronsResonance and Formal ChargeMolecular Polarity and Dipole MomentsIntermolecular ForcesStates of Matter and Phase Changes: Melting, Boiling, and SublimationGas Laws and the Ideal Gas EquationGas Stoichiometry and Volume-Volume CalculationsThermochemistry and EnthalpyHeat Capacity and CalorimetryEntropy and Molecular DisorderSpontaneity and ΔGEntropy and Gibbs Free EnergyChemical EquilibriumAcid-Base ChemistryOrganic Reaction Mechanisms and Arrow PushingSN2 Substitution ReactionsSN1 Substitution ReactionsE1 Elimination ReactionsAlcohols and Ethers: Structure, Properties, and NomenclatureReactions of AlcoholsAldehydes and Ketones: Structure and ReactivityNucleophilic Addition to Aldehydes and KetonesCarboxylic Acids and Their DerivativesNucleophilic Acyl SubstitutionAmines: Structure, Basicity, and ReactionsAmine Reactivity: Nucleophilicity and BasicityAmino Acid Structure and PropertiesPeptide Bonds and Polypeptide FormationProtein Primary StructureProtein Secondary StructureProtein Tertiary StructureIon Channels and Selective Permeability MechanismsSensory Receptor Transduction and AdaptationSensory Transduction and EncodingSensory Pathways OverviewVisual Processing PathwayThe Dorsal Stream and Action ControlDorsal Stream and Visuomotor ControlSpatial Attention and Posterior Parietal CortexPrefrontal-Parietal Attention Networks and ControlExecutive Control Networks and the Prefrontal CortexNeuroeconomics and Value ComputationNeural Mechanisms of Decision-MakingWorking Memory Neural CircuitsMemory Encoding and Levels of ProcessingSemantic Memory and Network ModelsMental Models in Understanding and ReasoningProblem Representation and Solution SearchExpert Cognition and Knowledge OrganizationSchemas and Knowledge OrganizationCognitive Biases and Judgment Under UncertaintyHeuristics in Judgment and Decision MakingBase-Rate Integration and Bayesian Reasoning in ProbabilityLogical Validity and Belief Bias in ReasoningFrequency Estimation and Metacognitive JudgmentOverconfidence and Metacognitive IllusionsCalibration TrainingReference Class ForecastingFermi EstimationExpected Value Decision-MakingSunk Cost Recognition and Rational QuittingNewcomb's ProblemCausal vs. Evidential Decision TheoryConservation of Expected Evidence

Longest path: 216 steps · 1389 total prerequisite topics

Prerequisites (4)

Leads To (1)