A historian studying working-class women's experiences in 1920s Chicago uses court records, government surveys, and settlement house case records — all digitized and freely accessible online — because examining physical archives is time-prohibitive. What is the primary methodological problem with this approach?
ADigital sources are less reliable than physical archival documents and should not be used for serious research
BThe sample systematically excludes women who avoided institutional contact, biasing findings toward those who interacted with official systems
CThe time period is too recent for these sources to count as primary sources
DUsing multiple source types introduces conflicting evidence that cannot be resolved
This is convenience sampling — using sources that are easy to access rather than sources best suited to the question. Institutional records (courts, government agencies, settlement houses) systematically capture only people who had contact with those institutions. Working-class women who avoided official attention, lived outside the settlement house service area, or resolved problems through informal networks would be invisible in this source set. The resulting picture would systematically overrepresent women in crisis or under official scrutiny — potentially a very skewed sample of working-class women's experience.
Question 2 Multiple Choice
A historian explicitly states in her methodology section that she examined only French-language sources, thereby excluding Spanish and Portuguese colonial documents that might contain relevant evidence. Why is this transparency about exclusions methodologically important?
AIt is a courtesy to other historians, not a methodological requirement
BIt allows readers to evaluate the argument's scope and identify what the conclusions cannot establish
CIt prevents the historian from being criticized for not knowing other languages
DIt is only important if the excluded sources would have changed the conclusion
Transparency about exclusions is not optional decoration — it is what allows readers to properly evaluate the argument. A conclusion is only as strong as the representativeness of its sources. If Spanish and Portuguese records might contain substantial counter-evidence, readers need to know this to assess the argument's limits. Without this information, readers cannot distinguish a robust conclusion (supported even if those sources were included) from a fragile one (dependent on ignoring contradictory evidence). The historian's job is not just to argue but to make the argument's basis transparent.
Question 3 True / False
A historian's conclusions are only as strong as the representativeness of the sources examined — knowing which sources were excluded is part of evaluating the strength of the argument.
TTrue
FFalse
Answer: True
Source selection is not a preliminary step that can be left implicit — it shapes every conclusion the historian draws. If the selected sources systematically over- or under-represent certain groups, perspectives, or geographies, the conclusions will reflect that bias whether or not the historian acknowledges it. Readers who know which sources were excluded can identify which populations and perspectives are likely missing, which conclusions might not hold for those excluded groups, and where follow-up research is most needed.
Question 4 True / False
When a research question can seldom be answered by examining most available source, the best methodological practice is to use whatever sources are most readily accessible to maximize efficiency.
TTrue
FFalse
Answer: False
Using the most accessible sources is convenience sampling — a common but methodologically weak practice. The correct approach is to define the source population (all sources potentially relevant to the question), develop inclusion criteria derived from the research question, and then select from that population deliberately — even if access is difficult. Convenience sampling is often the only practical option, but when it is used, it should be explicitly acknowledged as a limitation rather than left implicit, so readers can assess the bias it introduces.
Question 5 Short Answer
What is convenience sampling in historical research, and why is it methodologically problematic even when the sources a historian examines are individually high quality and well-evaluated?
Think about your answer, then reveal below.
Model answer: Convenience sampling means selecting sources based on ease of access rather than systematic relevance to the research question. It is methodologically problematic because the factors that make sources convenient to access — digitization, institutional preservation, proximity — are not random. They systematically favor certain types of sources (official records, elite correspondence, English-language materials), certain populations (those who interacted with institutions or could write), and certain geographies (well-resourced archives). Even if every examined source is authentic, carefully read, and properly analyzed, the conclusions will be biased if the sample is not representative of the source population. Quality of individual source evaluation cannot compensate for a biased selection strategy.
This is the distinction between internal validity (evaluating each source well) and external validity (whether your source set supports general conclusions). A historian can perfectly evaluate every document she reads while still producing a systematically skewed picture if her sampling strategy was driven by convenience. Source selection strategy is about the latter — designing the sample, not evaluating the items in it.