A vaccine showed 95% efficacy in a phase III RCT among adults aged 18–65 during controlled trial conditions. Six months after rollout among elderly populations, field studies estimate 60% effectiveness. Which explanation best accounts for this gap?
AThe field studies are unreliable — effectiveness estimates are inherently less accurate than RCT efficacy
BThe gap is a statistical artifact because elderly populations are too small to yield precise estimates
CVaccine effectiveness differs from efficacy due to real-world factors: different population (elderly, more comorbidities), waning immunity over time, and possible strain evolution
DThe trial overestimated efficacy because it used the test-negative design
Efficacy and effectiveness measure different things. Trial efficacy is measured under ideal, controlled conditions in a selected population. Real-world effectiveness reflects what the vaccine actually does in heterogeneous populations, with different immune backgrounds, waning immunity over months, and evolving circulating strains. None of these forces should make the estimates identical. The gap between 95% and 60% is not a measurement failure — it is the exact signal that vaccine surveillance programs exist to detect. Options A and B misidentify a real biological phenomenon as a statistical problem. Option D confuses study design (the test-negative design is used for field studies, not RCTs).
Question 2 Multiple Choice
Why does the test-negative design effectively reduce healthy vaccinee bias in influenza vaccine effectiveness studies?
AIt randomizes patients between vaccinated and unvaccinated groups
BBoth test-positive cases and test-negative controls sought care for flu-like illness, so health-seeking behavior is balanced between groups — the key confounder is controlled by design
CIt excludes elderly patients, who are disproportionately targeted for vaccination
DIt measures antibody titers directly, bypassing the need to compare vaccinated and unvaccinated individuals
Healthy vaccinee bias arises because healthier, more health-conscious people are more likely to get vaccinated AND more likely to seek care — making vaccinated people look better than the vaccine actually makes them. The test-negative design controls this by enrolling only patients who already came to care with flu-like illness. Both test-positive cases and test-negative controls are care-seekers, so care-seeking behavior is similar in both groups. Vaccination status is then compared within this care-seeking population, removing the confounding effect of differential care-seeking. This is an elegant observational design solution that does not require randomization.
Question 3 True / False
A cohort study following vaccinated and unvaccinated individuals may overestimate vaccine effectiveness if healthier, more health-conscious individuals are more likely to seek vaccination.
TTrue
FFalse
Answer: True
This is the healthy vaccinee bias. If vaccinated people are systematically healthier than unvaccinated people (due to health-consciousness, access, or physician recommendation patterns), then even a vaccine with no efficacy would appear to protect them — their lower disease rates would partly reflect pre-existing health differences. Controlling for measured confounders (age, sex, comorbidities) helps, but unmeasured health-consciousness or health-seeking behavior is hard to fully adjust for. This is one reason observational VE estimates require careful interpretation.
Question 4 True / False
Vaccine effectiveness against influenza is approximately constant throughout a season because the immune response is fully established before the flu season begins.
TTrue
FFalse
Answer: False
VE against influenza wanes measurably within a single season. Vaccine-induced antibody titers decline over time, and circulating influenza strains may drift away from vaccine strains as the season progresses. Studies consistently show higher VE in the weeks immediately following vaccination than later in the season. This is why time-stratified VE analysis is important — it estimates effectiveness in windows defined by time since vaccination, capturing the waning pattern. For COVID-19, the waning was even more dramatic, driving booster dose recommendations. VE is not a fixed number but a function of time since vaccination, among other variables.
Question 5 Short Answer
Why should vaccine effectiveness be understood as a function of multiple variables rather than as a single fixed number, and what are the key variables it depends on?
Think about your answer, then reveal below.
Model answer: VE is not a stable property of a vaccine but varies with: (1) the pathogen strain — a vaccine calibrated against one variant may be less effective against a drifted strain; (2) the target population — age, immune history, comorbidities, and prior infection all affect immune response; (3) time since vaccination — immunity wanes, so early post-vaccination VE may be 90% while VE six months later could be 50%; and (4) the clinical endpoint — VE against any infection is typically lower than VE against symptomatic disease, which is lower than VE against hospitalization or death. A single headline number (e.g., '95% effective') is a snapshot at a specific time, in a specific trial population, against a specific strain, measuring a specific outcome. Treating it as a universal constant leads to both overconfidence and unjustified dismissal of vaccines as protection wanes.