Questions: Demand Characteristics and Participant Awareness in Research

Question 1

A researcher studies whether a mindfulness intervention reduces test anxiety. Experimental participants are told they are receiving 'mindfulness training to help with anxiety'; controls receive no treatment. After the intervention, experimental participants report significantly lower anxiety. What is the most important validity threat to address?

• A. Experimenter bias from the researcher who administered the test
• B. That participants who received mindfulness training simply practiced more for the exam
• C. Demand characteristics: participants who knew they received the intervention may have reported lower anxiety because they believed they were supposed to improve
• D. Attrition: experimental participants may have dropped out at higher rates

Answer: (C)

When participants know which condition they're in, they form hypotheses about expected results and may adjust their self-report accordingly — especially for subjective measures like anxiety. The 'good subject' effect leads participants to confirm the hypothesis. A blind procedure (where neither group knows whether they received the 'real' treatment) or a cover story disguising the study's true purpose would reduce this threat. Without it, the reported improvement may reflect demand characteristics rather than the intervention's actual effect.

Question 2

A researcher suspects demand characteristics may have inflated their treatment effect. What is the most appropriate analytical response after data collection?

• A. Discard the study and start over with a new design
• B. Exclude all participants and report only theoretical predictions
• C. Conduct post-experimental inquiry to identify hypothesis-aware participants, re-run analyses excluding them, and report both sets of results
• D. Report only the significant result and note limitations in the discussion section

Answer: (C)

The standard response is systematic post-experimental inquiry followed by sensitivity analysis. If the effect holds among hypothesis-unaware participants, confidence in its validity increases. If it disappears, the effect may have been an artifact of demand characteristics. Transparent reporting of both analyses lets readers judge the evidence. Omitting the inquiry results or simply noting limitations without the analysis is inadequate.

Question 3

Demand characteristics usually lead research participants to artificially confirm the researcher's hypothesis.

• T. True
• F. False

Answer: False

Demand characteristics produce multiple behavioral patterns. The 'good subject' effect (Orne) leads to hypothesis confirmation. But the 'screw you' effect leads some participants to deliberately oppose perceived expectations. Others respond in socially desirable ways that have nothing to do with the experimental manipulation. All three patterns contaminate the experiment's signal — they just distort it in different directions. Demand characteristics do not uniformly inflate effects; they systematically introduce noise aligned with participants' beliefs.

Question 4

In a double-blind study, participants can seldom form hypotheses about the study's purpose, substantially eliminating demand characteristic effects.

• T. True
• F. False

Answer: False

Double-blind procedures prevent participants from knowing which condition they're in and prevent experimenters from inadvertently communicating expectations. But they do not prevent participants from forming hypotheses — participants still observe the study environment, read instructions, and infer context from the questions they're asked and the equipment they see. Double-blind reduces demand characteristic effects, particularly condition-based strategy, but cannot eliminate the participant's natural tendency to theorize about the study.

Question 5

Why are demand characteristics considered a threat to internal validity rather than just a minor nuisance, and what is the standard method for detecting them after data collection?

Model answer: Demand characteristics are an internal validity threat because they introduce a systematic alternative explanation for the observed effect: participants' beliefs about the expected response — not the independent variable — may be driving the outcome. This makes it impossible to conclude the treatment caused the change when the direction of change is exactly what participants predicted the researcher wanted. The standard detection method is post-experimental inquiry: asking participants what they thought the study was about and whether they guessed the hypothesis. If hypothesis-aware participants show larger effects than unaware participants, demand characteristics are plausibly inflating the estimate.

Internal validity requires that the only systematic difference between conditions is the treatment. Demand characteristics violate this by adding 'participants' beliefs about the treatment' as an additional systematic difference. The effect size you measure may be partly (or wholly) the product of cooperative participants behaving as they think they should rather than as the independent variable caused them to. Post-experimental inquiry combined with sensitivity analysis is the primary tool for detecting this — and for quantifying how much of the effect survives when hypothesis-aware participants are excluded.