A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.
Consequential validity extends beyond technical evidence to broader effects: how tests affect individuals, institutions, and society. Developers and users are ethically responsible for anticipated consequences (labeling, segregation, narrowed curriculum). Evaluating consequential validity requires interdisciplinary collaboration and explicit attention to who benefits and is harmed.
Review prominent testing controversies and analyze what consequences were unintended or ignored. Discuss ethical frameworks for balancing validity with fairness.
From your work on score interpretation and validity design, you know that a test can be technically well-constructed — reliable, sensitive to the construct being measured — and still be used in ways that harm people. Consequential validity is the framework that takes those harms seriously as evidence bearing on validity itself, not as unfortunate side effects separate from measurement quality.
The traditional view treated test validity as purely technical: does the test measure what it claims to measure? The consequential view, developed most influentially by Samuel Messick, argues that this is incomplete. A test is used in a context to make decisions about people. Those decisions have outcomes. If the outcomes systematically disadvantage particular groups, if the test triggers labeling that distorts how teachers treat students, if high-stakes testing narrows curriculum toward tested content alone — these are consequences that a validity argument must address. The question is not only "is the test accurate?" but "accurate for whom, used how, with what effects?"
Consider concrete examples. An employment selection test may predict job performance with acceptable criterion validity, yet systematically screen out minority applicants at higher rates than their actual job performance would justify — an adverse impact pattern that raises fairness questions even if the overall prediction is valid. A cognitive screener in schools may accurately identify learning difficulties but, if over-administered in under-resourced districts, may produce disproportionate special education placements that restrict rather than support student trajectories. A standardized exit exam may motivate study and signal achievement, but also incentivize "teaching to the test" in ways that crowd out unassessed but important learning. Each case involves a test that works in the narrow technical sense while generating consequences that demand scrutiny.
Evaluating consequential validity requires asking: who is affected, and how? What is the intended use, and is the test actually being used that way? Are there unintended side effects — on curricula, on labeling, on resource allocation, on the self-concepts of test-takers? Are differential effects distributed equitably across demographic groups? This is inherently an interdisciplinary problem: it requires measurement expertise, but also sociology, ethics, law, and domain knowledge about the institution where tests are deployed. The field increasingly treats consequential validity not as a separate add-on concern but as integral to the overall validity argument — building the case that a test interpretation is justified requires demonstrating that its uses produce defensible outcomes.