A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Disagreement and Rational Updating

Graduate Depth 265 in the knowledge graph ☐ I know this ☆ Set as goal

1,955prerequisites beneath it

Intellectual Humility and Calibrated Uncertainty Steelmanning +1 more→

Core Idea

Aumann's agreement theorem proves that two rational agents with common knowledge of each other's beliefs cannot agree to disagree — if they share the same priors and each knows the other's posterior, they must converge. In practice, persistent disagreement signals that at least one party has different priors, different evidence, or is reasoning incorrectly. The Rationalist approach to disagreement: take the other person's belief as evidence (their brain processed information you have not seen), update toward them proportional to your assessment of their reliability, and investigate the crux — the specific factual or inferential disagreement that drives the difference. Productive disagreement requires identifying cruxes rather than repeating arguments.

How It's Best Learned

In your next substantive disagreement, try to identify the crux: what is the specific factual claim or inference where you and the other person diverge? State it explicitly and check whether resolving that point would change both your minds. Practice taking the other person's confidence as evidence — if a domain expert disagrees with you, how much should you update?

Common Misconceptions

Aumann's theorem does not mean you should always split the difference with anyone who disagrees — it applies to rational agents with common priors and common knowledge, which is rarely fully satisfied.
Rational updating on disagreement does not mean deferring to the loudest or most confident person — it means weighting by assessed reliability and relevant expertise.

Explainer

From steelmanning, you know how to engage with the strongest version of an opposing argument. From intellectual humility, you know that calibrated confidence means being as certain as the evidence warrants, no more and no less. Disagreement and rational updating brings these skills to bear on one of the most common epistemic situations: someone you respect disagrees with you. What should you do?

The theoretical foundation is Aumann's agreement theorem, which proves that two rational agents with common priors and common knowledge of each other's posteriors cannot agree to disagree -- they must converge on the same probability estimate. The conditions are strict: shared priors, and each party knowing what the other believes (and knowing that the other knows, and so on). These conditions are rarely fully met in practice. But the theorem's practical lesson survives the idealization: persistent disagreement between reasonable people is a signal that something is going on -- different priors, different evidence, or reasoning errors on one or both sides. Treating disagreement as merely a difference of opinion misses the information it contains.

The Rationalist approach treats another person's belief as evidence. Their brain has processed information you have not seen, made inferences you have not made, and arrived at a conclusion that encodes all of that processing. When a well-calibrated domain expert tells you she estimates the probability of H at 30% and you had it at 70%, her estimate is a data point -- not as authoritative as a controlled experiment, but not as dismissible as mere opinion either. The rational response is to update toward her estimate by an amount proportional to your assessment of her reliability and relevant expertise. You do not blindly average (that ignores differences in information quality), you do not fully defer (that ignores your own information), and you certainly do not refuse to update (that treats your prior as immune to evidence).

The most productive move in any substantive disagreement is to identify the crux -- the specific factual claim, inference, or value judgment that actually drives the divergence. Most disagreements cycle endlessly because both parties restate their conclusions rather than locating the premise where they part ways. A crux-finding approach asks: "What would have to be true for you to update toward my view?" and "What would have to be true for me to update toward yours?" This locates the actual point of divergence, where evidence could potentially resolve the dispute. Once you have identified the crux, you can investigate it directly rather than rehearsing downstream disagreements that neither party will concede without the upstream issue being settled. This turns unproductive argument into collaborative inquiry -- which is what rational disagreement is supposed to be.

What did you take from this?

Topics in reflective domains aren't scored by quiz answers. Read, reflect, and mark when you've thought it through.

Quiz me anyway →

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → One-to-One Correspondence → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Making 10 as an Addition Strategy → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Dividing Integers → Unit Rates → Proportions → Percent Concept → Converting Between Fractions, Decimals, and Percents → Operations with Rational Numbers → Two-Step Equations → Solving Multi-Step Equations → Equations with Variables on Both Sides → Angle Pairs: Complementary, Supplementary, and Vertical → Parallel Lines and Transversals → Corresponding Angles → Alternate Interior Angles → Triangle Angle Sum Theorem → Exterior Angle Theorem → Triangle Inequality Theorem → Similar Triangles: AA Similarity → Similar Triangles: SSS and SAS Similarity → Proportions in Similar Triangles → Right Triangle Trigonometry Introduction → Sine, Cosine, and Tangent Ratios → Trigonometric Ratios Review → Radian Measure → Converting Between Degrees and Radians → The Unit Circle → Graphing Sine and Cosine → Graphing Tangent and Reciprocal Trigonometric Functions → Derivatives of Trigonometric Functions → Antiderivatives → Iterated Integrals and Fubini's Theorem → Double Integrals in Cartesian Coordinates → Double Integrals in Polar Coordinates → Double Integrals in Polar Coordinates → Double Integrals: Definition and Setup → Iterated Integrals and Fubini's Theorem → Double Integrals over Rectangular Regions → Double Integrals over General Regions → Applications of Double Integrals: Area, Mass, and Moments → Triple Integrals in Cartesian Coordinates → Triple Integrals in Cylindrical and Spherical Coordinates → Change of Variables and the Jacobian Determinant → Applications of Triple Integrals: Volume and Mass → Vector Fields and Their Representations → Line Integrals of Vector Fields → Work and Circulation → Line Integrals of Scalar and Vector Functions → Fundamental Theorem for Line Integrals → Conservative Vector Fields → Conservative Vector Fields and Potential Functions → Curl and Divergence of Vector Fields → Curl and Divergence → Divergence Theorem → Electric Flux and Divergence Theorem → Gauss's Law: Integral Form and Meaning → Solving Problems with Gauss's Law → Conductors in Electrostatic Equilibrium → Capacitance and Capacitors → Dielectrics → Dielectric Constant and Relative Permittivity → Electric Field Inside Dielectric Materials → Dielectric Materials and Polarization → Dielectric Susceptibility and Permittivity → Energy Density in Electric Fields → Electric Current and Current Density → Electrical Resistance and Resistivity → Ohm's Law and Circuit Elements → Electromotive Force (EMF) and Batteries → Kirchhoff's Circuit Laws: Voltage and Current → DC Circuit Network Analysis Methods → Transient Response in RC Circuits → RC Circuits → LC and RLC Circuits → AC Circuits: Fundamentals → Impedance and Reactance → AC Power and Resonance → Electromagnetic Waves → Postulates of Special Relativity → Time Dilation → Length Contraction → Lorentz Transformation → Relativistic Velocity Addition → Relativistic Momentum and Energy → Mass-Energy Equivalence and E=mc² → Photons as Particles with Energy and Momentum → Planck-Einstein Relation: Energy and Frequency → Photoelectric Effect → The Photon: Light as Quanta → Compton Scattering → Wave-Particle Duality → de Broglie Wavelength → The Schrödinger Equation → State Vectors and Wavefunctions → Quantum Superposition → The Measurement Problem → Interpretations of Quantum Mechanics → Postulates of Quantum Mechanics → Observables and Quantum Operators → Commutators and Commutation Relations → Quantum Angular Momentum → Quantum Mechanical Treatment of Hydrogen → Solving the Schrödinger Equation for Hydrogen Atom → Quantum Numbers → Electron Configuration → Periodic Trends → Covalent Bonding → Electronegativity and Bond Polarity → Ionic Bonding → Lewis Structures → VSEPR Theory and Molecular Geometry → Molecular Geometry and Electron Pair Geometry → Molecular Polarity and Dipole Moments → Intermolecular Forces → States of Matter and Phase Changes: Melting, Boiling, and Sublimation → Gas Laws and the Ideal Gas Equation → Gas Stoichiometry and Volume-Volume Calculations → Thermochemistry and Enthalpy → Heat Capacity and Calorimetry → Entropy and Molecular Disorder → Spontaneity and ΔG → Entropy and Gibbs Free Energy → Chemical Equilibrium → Acid-Base Chemistry → Weak Acid Ionization → Weak Base Ionization → Acid and Base Strength: Ka, Kb, and Ionization → Leaving Groups and Nucleofugality → SN2 Substitution Reactions → SN1 Substitution Reactions → E1 Elimination Reactions → Alcohols and Ethers: Structure, Properties, and Nomenclature → Reactions of Alcohols → Aldehydes and Ketones: Structure and Reactivity → Oxidation Reactions in Organic Chemistry → Oxidation of Alcohols to Aldehydes and Ketones → Aldehyde and Ketone Structure and Nomenclature → Nucleophilic Addition to Aldehydes and Ketones → Carboxylic Acids and Their Derivatives → IUPAC Nomenclature of Carbonyls and Carboxylic Acids → IUPAC Nomenclature of Alkenes → Electrophilic Addition to Alkenes → Aromaticity and Benzene → Electrophilic Aromatic Substitution (EAS) → Nucleophilic Aromatic Substitution (SNAr) → Nucleophilic Acyl Substitution → Amines: Structure, Basicity, and Reactions → Amine Reactivity: Nucleophilicity and Basicity → Amino Acid Structure and Properties → Peptide Bonds and Polypeptide Formation → Protein Primary Structure → Protein Secondary Structure → Protein Tertiary Structure → Enzyme Structure and Function → Transcription: DNA to RNA → RNA Types and Structure → RNA Structure and Intramolecular Base Pairing → RNA Processing and Splicing → Translation: RNA to Protein → Ribosomes: Protein Synthesis Machines → Translation: Initiation and Elongation → Post-Translational Modifications → Proteasomal Degradation and Ubiquitin-Mediated Marking → Cell Cycle Regulation and Checkpoints → Mitosis → Cytokinesis → Meiosis → Chromosomal Theory of Inheritance → Mendelian Genetics → Dominance, Recessiveness, and Allelic Interactions → Sex-Linked Inheritance → Non-Mendelian Inheritance Patterns → Population Genetics and Hardy-Weinberg Equilibrium → Natural Selection → Adaptation and Fitness → Life History Strategies: r- and K-Selection → Predator-Prey Dynamics and the Lotka-Volterra Model → Community Ecology: Structure and Organization → Species Interactions: Competition, Predation, Mutualism, and Parasitism → Trophic Levels and Food Webs → Energy Flow and Ecological Efficiency → Biogeochemical Cycles: Carbon, Nitrogen, and Phosphorus → Nitrogen Fixation, Availability, and Cycling → Phosphorus Cycling and Freshwater-Marine Differences → Nucleotide Structure and Nomenclature → Purine Biosynthesis → Nucleotide Salvage Pathways → Nucleotide Synthesis Pathways (De Novo and Salvage) → Transcription Initiation and Gene Regulation → Gene Regulation in Eukaryotes → Epigenetics → Genetics and Behavior → Prenatal Development → Nature–Nurture Debate → Critical Periods and Sensitive Periods → Critical Periods in Neural Development → Brain Plasticity and Recovery After Injury → Experience-Dependent Plasticity and Learning → Long-Term Potentiation (LTP): Synaptic Strengthening → Long-Term Depression (LTD): Synaptic Weakening → Systems Consolidation and Sleep-Dependent Memory → Memory Reconsolidation and Post-Retrieval Lability → Memory Storage and Consolidation → Declarative and Procedural Memory Systems → Procedural Memory and Skill Acquisition → Expert Cognition and Knowledge Organization → Schemas and Knowledge Organization → Cognitive Biases and Judgment Under Uncertainty → Heuristics in Judgment and Decision Making → Dual-Process Theory of Cognition → Metacognition and Self-Regulated Thinking → Frequency Estimation and Metacognitive Judgment → Overconfidence and Metacognitive Illusions → Calibration Training → Intellectual Humility and Calibrated Uncertainty → Disagreement and Rational Updating

Longest path: 266 steps · 1955 total prerequisite topics

Prerequisites (3)

Steelmanninghard Intellectual Humility and Calibrated Uncertaintyhard Epistemology of Disagreementsoft

Leads To (0)

No topics depend on this one yet.