Questions: Evaluating Testimony and Authority

Question 1

A drug company reports their medication is 80% effective. An independent review by researchers with no financial ties to the manufacturer finds 45% effectiveness. A cardiologist who consults for the company recommends the drug. How should these sources be weighted?

• A. The company's data most heavily — they have the most resources and a direct incentive to be accurate
• B. The independent review most heavily — it has greater independence from parties with financial stakes in the outcome
• C. The cardiologist's recommendation most heavily — medical domain expertise is the key variable
• D. All three equally — when sources disagree, we should remain agnostic

Answer: (B)

Independence from conflicting interests is a critical factor in testimonial credibility. The company has a strong financial incentive to show high effectiveness, undermining its independence. The cardiologist also has a consulting relationship with the company (conflict of interest). The independent review with no financial ties ticks the most credibility boxes: domain expertise, independence, and absence of financial conflict. Testimonial disagreement does not require agnosticism when asymmetries in credibility are visible.

Question 2

A Nobel Prize-winning physicist gives a widely-viewed interview arguing for a specific immigration policy. How should this testimony be weighted?

• A. Very highly — Nobel laureates have demonstrated extraordinary intelligence applicable across domains
• B. As you would weight any thoughtful non-expert opinion — their track record in physics does not transfer to immigration policy
• C. Moderately — expertise in a quantitative field provides some evidence of competence in related policy analysis
• D. Not at all — credentialed experts should only ever speak publicly within their exact specialty

Answer: (B)

Expertise scope is domain-specific. A Nobel laureate's track record of accurate, peer-validated claims is specifically in their field of physics, not in economics, political science, or policy. Deference to an expert's authority is justified only within their area of demonstrated competence. Outside that domain, they are offering an opinion that warrants the same scrutiny as any thoughtful layperson's. This does not mean ignoring them — it means calibrating the weight of their testimony to the domain.

Question 3

When two apparent authorities disagree, examining asymmetries in their independence, track record, and domain expertise can provide rational grounds for favoring one position.

• T. True
• F. False

Answer: True

Testimonial disagreement does not automatically require agnosticism. The question is not 'do experts disagree?' but 'what explains the disagreement, and which side has the stronger epistemic position?' Asymmetries in conflict of interest, depth of domain experience, scope of peer support, and predictive track record can all favor one side. Treating all expert disagreement as equally canceling out is itself an epistemic error — it ignores the structure of the disagreement.

Question 4

Citing a credentialed expert as evidence for a claim is sufficient justification, because credentials establish domain authority.

• T. True
• F. False

Answer: False

Credentials are one factor in assessing testimonial credibility, not a sufficient condition on their own. The appeal-to-authority fallacy specifically targets the mistake of treating authority as a conversation-stopper. A credentialed expert may have conflicts of interest, be outside their domain of expertise, lack a strong track record on the specific type of claim, or represent a minority position within their field. Credentials warrant attention to the testimony; they don't end the evaluation.

Question 5

What distinguishes an inappropriate appeal to authority from legitimate reliance on testimony? What factors make testimonial evidence genuinely strong?

Model answer: An inappropriate appeal to authority cites someone whose credentials are irrelevant to the claim (wrong domain), ignores conflicts of interest, or treats authority as proof rather than evidence. Legitimate testimonial evidence is strong when the source has: (1) domain expertise directly relevant to the claim, (2) a track record of accurate claims in that domain, (3) independence from parties with financial or ideological stakes in the conclusion, and (4) no strong personal incentive to mislead. The more of these conditions are met, the more the testimony functions as genuine evidence — not because the expert cannot be wrong, but because the conditions that systematically produce error are absent.

The positive account of good testimony is what makes this topic more than just 'watch out for fallacies.' We rely on testimony for the vast majority of our beliefs, so developing a principled positive account of what makes testimony credible is one of the most practically important epistemological skills.