A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.
Higher-order evidence is evidence about one's evidence or about the reliability of one's belief-forming methods—such as learning that a trusted source has been discredited or that experts disagree about a topic. Higher-order evidence can defeat or undermine first-order justification without changing the original evidence. This concept is crucial for understanding how knowledge of our own fallibility and cognitive limitations should affect our confidence in current beliefs.
Consider cases of higher-order defeat: learning that your reasoning method gives wrong answers, discovering experts disagree, or learning about cognitive biases. Analyze how this evidence about evidence affects first-order justification.
Your Bayesian framework gives you a way to model how evidence updates beliefs: new evidence e raises the probability of hypothesis h when P(h|e) > P(h). That is first-order evidence — evidence about the world. Higher-order evidence is different in kind: it is evidence *about your own evidence or your reasoning process itself*. Learning that a trusted expert has been caught fabricating data doesn't change the data you read from them — but it changes what that data is worth. Learning that you are mildly intoxicated doesn't change the argument you just constructed — but it changes how much you should trust the conclusion you reached.
The key technical concept is epistemic defeat. A defeater is any factor that undermines or overrides a belief that was previously justified. Philosophers distinguish two types. A rebutting defeater gives you positive reason to believe the opposite of what you believed. A undercutting defeater doesn't support the opposite — it simply removes the justificatory support for your original belief. Higher-order evidence typically works as an undercutting defeater: it doesn't tell you your belief is *wrong*, it tells you the process that generated your belief is *unreliable*. If you learn that a specific lottery ticket-scanning machine makes systematic errors, you don't thereby know that your ticket *is* a winner — you just lose confidence in what the machine told you.
A vivid case: suppose you do a complex arithmetic calculation in your head and get an answer. You have some justification for believing that answer is correct. Now a reliable math expert tells you that calculations like this one are extremely difficult and that even trained mathematicians fail them 70% of the time. You haven't gotten new *mathematical* evidence — the problem hasn't changed. But you now have evidence that your belief-forming method is unreliable for this problem type. This higher-order evidence rationally requires you to reduce confidence in your calculation. Notice the structure: the higher-order evidence operates on the *relationship between you and the evidence*, not on the evidence itself.
This creates a genuine philosophical puzzle: should higher-order evidence always dominate first-order evidence? Some philosophers (the conciliationist view) say yes — if you discover that a rational peer disagrees with your conclusion, you must always reduce confidence. Others (the steadfast view) say no — if your first-order evidence is strong enough, you may maintain your position even against peer disagreement, treating your confidence in the evidence as itself evidence that you're right. The Bayesian framework models this as a question about priors: how much should you weight your assessment of your own reliability? Neither view has a clean answer, but the tension reveals something important — rationality is not just about responding to evidence about the world, but about calibrating your confidence in yourself as an evidence-processor.
Topics in reflective domains aren't scored by quiz answers. Read, reflect, and mark when you've thought it through.