Infectious Epidemiology: Vaccine Efficacy vs. Effectiveness & Diagnostic PPV
During infectious outbreaks and routine public health surveillance, clinicians and citizens are flooded with percentages: "Test accuracy is 98%," or "Vaccine protection is 90%." Without knowing whether the endpoint was asymptomatic PCR positivity or ICU hospitalization, and without applying Bayes' theorem to community prevalence, those numbers are routinely misread.
Two statistical traps dominate infectious disease headlines: confusing controlled trial Vaccine Efficacy (measured over short follow-up in healthy volunteers) with real-world Vaccine Effectiveness (which wanes with viral antigenic drift and host frailty), and ignoring baseline disease prevalence when interpreting diagnostic tests. When prevalence is 0.5%, even a test with 99% sensitivity and 98% specificity has a Positive Predictive Value (PPV) of only 19.7%, meaning 4 out of 5 positive results are false alarms.
Why a "98% Specific" Diagnostic Test Produces 80% False Positives When Disease Prevalence Is Low
Sensitivity and specificity are fixed laboratory properties of an assay, whereas Positive Predictive Value (PPV: the probability that a patient with a positive test actually has the infection) shifts dramatically with community prevalence.
| Community Prevalence | True Positives (Infected & Test +) | False Positives (Healthy & Test +) | Positive Predictive Value (PPV) | Clinical Interpretation |
|---|---|---|---|---|
| 0.5% Prevalence Low-season mass screening (5 infected / 995 uninfected) |
4.95 (~5 people) | 19.90 (~20 people) (2% of 995 healthy) |
19.9% PPV (5 / 25 total positives) |
80% FALSE ALARMS 4 out of 5 positive results are false positives; mandatory confirmatory orthogonal testing required. |
| 5.0% Prevalence Moderate community transmission (50 infected / 950 uninfected) |
49.5 (~50 people) | 19.0 (~19 people) (2% of 950 healthy) |
72.3% PPV (50 / 69 total positives) |
MODERATE PREDICTIVE VALUE Nearly 3 in 4 positive tests are true infections. |
| 30.0% Prevalence Symptomatic fever clinic outbreak (300 infected / 700 uninfected) |
297.0 (~297 people) | 14.0 (~14 people) (2% of 700 healthy) |
95.5% PPV (297 / 311 total positives) |
HIGH DIAGNOSTIC CERTAINTY Targeted testing in symptomatic patients maximizes PPV. |
Primary sources: BMJ (Altman & Bland, Diagnostic Tests: Predictive Values) · CDC Vaccine Efficacy & Effectiveness Methodology.
Vaccine Efficacy (RCT) vs. Real-World Effectiveness (Test-Negative Case-Control)
When reading infectious disease studies, always check three methodological dimensions:
1. Endpoint Stratification: Any Infection vs. Severe Hospitalization
Mucosal respiratory viruses (influenza, SARS-CoV-2, RSV) have short incubation periods (2 to 4 days). Circulating serum neutralizing antibodies wane within 3 to 6 months, causing protection against mild symptomatic infection to drop rapidly. Memory T-cell and B-cell responses, which take 3 to 5 days to mobilize, continue to protect against lower-respiratory progression and ICU admission. Any paper reporting a single unstratified "effectiveness" number without separating mild infection from severe disease is incomplete.
2. Healthy-Vaccinee Bias in Observational Databases
In observational registry studies of older adults, frail nursing-home patients near the end of life are often less likely to receive seasonal boosters, while mobile, health-conscious seniors get vaccinated promptly. If an observational study shows that a respiratory vaccine reduced non-infectious all-cause mortality during summer months before viral circulation began, the study suffers from severe healthy-vaccinee confounding.
3. Antimicrobial Stewardship in Academic Hospitals
Preserved from the 2020 MedRead Journal of Pharmaceutical Sciences archive ("Impact of a Pediatric Antimicrobial Stewardship Program in an Academic Medical Center"): prospective audit-and-feedback protocols cut broad-spectrum carbapenem and vancomycin days of therapy (DOT per 1,000 patient-days) by 22% to 35% without increasing 30-day readmission or mortality.
Frequently Asked Methodological & Clinical Questions
Plain-language answers grounded in CONSORT, GRADE, WHO guidelines, and per-1,000 absolute outcome arithmetic.
What is the difference between vaccine efficacy and vaccine effectiveness?
Vaccine efficacy is measured in an idealized Randomized Controlled Trial (RCT) comparing attack rates between randomly assigned vaccinated and placebo arms. Vaccine effectiveness is measured in real-world observational populations (often using a test-negative design) across diverse ages, comorbidities, cold-chain conditions, and evolving viral variants.
Source: WHO (Vaccine Efficacy, Effectiveness and Protection)
What is the test-negative design (TND) in infectious disease research?
In a test-negative study, researchers enroll patients who present to a clinic or hospital with the same acute clinical syndrome (such as fever and cough) and test all of them for the pathogen. Those who test positive serve as cases and those who test negative serve as controls, reducing bias from differences in healthcare-seeking behavior.
Source: NEJM (Jackson & Nelson, The Test-Negative Design for Estimating Influenza VE)
Why shouldn't asymptomatic populations undergo broad multi-pathogen PCR panels without clinical indication?
When pretest probability (disease prevalence) is very low, even highly specific assays generate more false positives than true positives, leading to unnecessary isolation, anxiety, and inappropriate antibiotic courses that disrupt the microbiome and select for antimicrobial resistance.
Source: Clinical Infectious Diseases (IDSA Diagnostic Stewardship Guidelines)