Questions: Qualitative Data Analysis, Coding, and Thematic Synthesis
5 questions to test your understanding
Score: 0 / 5
Question 1 Multiple Choice
A researcher conducting thematic analysis of 30 interviews finds that one participant describes a specific experience of institutional betrayal in rich detail that no other participant mentions. Which conclusion is most defensible?
AThe theme should be excluded — it appears in only 3% of interviews and fails the frequency threshold
BThe theme may be analytically central if it illuminates something structurally significant about the phenomenon, regardless of frequency
CThe theme can only be included if at least 20% of participants mentioned it
DThe theme is valid only if it was part of the pre-existing deductive coding scheme
Frequency does not equal importance in thematic analysis. A theme mentioned by one participant can be analytically central if it represents a structurally significant aspect of the phenomenon under study. Conversely, a theme mentioned 300 times may be background noise. Interpretation — whether the pattern illuminates the research question — drives inclusion, not counting. Options A and C mistake qualitative analysis for quantitative content analysis, which does use frequency thresholds.
Question 2 Multiple Choice
Two coders achieve a Cohen's kappa of 0.82 when independently coding the same interview transcripts. What does this demonstrate?
AThe analysis is fully objective — subjective judgment has been eliminated from the coding process
BThe codes are defined clearly enough that different researchers apply them consistently, making the interpretive process transparent and reproducible
CThe sample has reached saturation and no further data collection is needed
DInductive coding was used, since deductive coding cannot achieve high agreement rates
Inter-coder reliability (kappa ≥ 0.7 is a common benchmark) demonstrates that codes have been defined clearly enough for consistent application — not that subjectivity has been eliminated, but that it has been rendered transparent and reproducible. Disagreements that remain are discussed and often improve code definitions, making the process generative. Options A and D mischaracterize both the purpose of ICR and the nature of qualitative analysis. Option C confuses reliability with saturation, which is a separate criterion.
Question 3 True / False
Saturation in qualitative research is reached when the researcher has interviewed a minimum number of participants, typically 15 to 20, as specified by methodological guidelines.
TTrue
FFalse
Answer: False
Saturation is a functional criterion — reached when new data yield no new codes or themes — not a numerical one. The number of interviews needed to reach saturation depends on the heterogeneity of the phenomenon and the specificity of the research question. A homogeneous, narrowly defined phenomenon may saturate at 8 interviews; a heterogeneous, complex one may require many more. Reporting saturation requires documenting *when* new material stopped emerging, not claiming a magic number was reached.
Question 4 True / False
Inductive coding and deductive coding are mutually exclusive approaches — a researcher should choose one before beginning analysis and apply it throughout.
TTrue
FFalse
Answer: False
Most rigorous qualitative analyses blend both approaches. Researchers often begin inductively — reading and re-reading data to allow codes to emerge without pre-existing categories — then apply theoretical frameworks deductively as organizing structures. The choice reflects epistemological stance (grounded theory resists premature theory-imposition; framework analysis uses theory as scaffolding from the start), but in practice, most analyses involve iterative movement between bottom-up emergence and top-down conceptual organization.
Question 5 Short Answer
Why is the assumption that 'frequency of codes equals importance' problematic in thematic analysis? What does determine whether a theme is analytically significant?
Think about your answer, then reveal below.
Model answer: Frequency confuses quantitative content analysis logic with qualitative thematic analysis. In thematic analysis, significance is determined by whether a pattern illuminates something structurally important about the phenomenon under study — not by how often it appears. A single participant's vivid description of a structurally significant experience may be more analytically central than a theme repeated by every participant but representing surface-level background noise. The researcher's interpretive judgment — guided by the research question and theoretical framework — determines importance.
The distinction matters practically: if researchers only report frequent codes, they risk producing trivial findings (everyone mentioned feeling tired) while missing the analytically rich, structurally significant patterns that give qualitative research its unique value. Frequency-as-importance is a category error that imports quantitative reasoning into an interpretive framework where it does not belong.