Study designs and screening
Study designs, screening test performance, measures of risk and the role of chance
Statistics questions are mostly short calculations from a two-by-two table plus recognising the right study design, bias or measure of effect. Learn the formulas once with one table and a few worked examples, and the rest follows.
One of the most tested topics in past papers
Study designs
| Design | Starts from | Measure | Strengths | Weaknesses |
|---|---|---|---|---|
| Cross-sectional | A population at one time | Prevalence | Quick, cheap; service planning | No temporality |
| Case–control | Outcome (cases and controls), looks back at exposure | Odds ratio | Best for rare diseases; quick; many exposures | Recall bias, choice of controls |
| Cohort (prospective or retrospective) | Exposure, follows forward | Incidence, relative risk, attributable risk | Temporality; rare exposures; many outcomes | Costly, slow, loss to follow-up |
| Randomised controlled trial (RCT) | Allocation by chance | RR, ARR, NNT, hazard ratio | Controls known and unknown confounders | Cost, ethics, generalisability |
| Systematic review and meta-analysis | All eligible studies | Pooled estimate (forest plot) | Highest level of evidence | Only as good as the studies; publication bias |
- Phases of drug studies: I safety and kinetics; II efficacy and dose; III large RCT before licensing; IV post-marketing surveillance.
- Superiority versus non-inferiority: a non-inferiority trial aims only to show the new treatment is not worse than the standard by more than a pre-set margin, because it has another advantage (for example a heat-stable uterotonic for hot regions without a cold chain). Failing to show superiority is not the same as showing non-inferiority.
- Intention-to-treat analyses everyone as randomised, preserving randomisation.
- Allocation concealment prevents selection bias at recruitment; blinding prevents observer and placebo effects after allocation.
- Survival analysis: when people are followed for different lengths of time, Kaplan–Meier curves show survival over time, and Cox proportional hazards regression gives a hazard ratio (for example 0.70, 95% CI 0.55–0.89: a 30% lower instantaneous risk of recurrence).
Bias and confounding
- Recall (memory) bias: mothers of malformed babies remember medicines more thoroughly than mothers of healthy babies; use records made before the outcome. Typical of case–control studies.
- Selection bias: convenience samples, hospital controls (Berkson bias), healthy screening attenders.
- Publication bias: positive studies are more likely to be published. A funnel plot (effect size against study size) is asymmetrical when small negative studies are missing.
- Hawthorne effect: people change behaviour because they are studied.
- Screening biases: lead-time (diagnosed earlier, death unchanged), length-time (slow tumours detected more), overdiagnosis.
- Confounder: linked to both exposure and outcome but not on the causal pathway (birth order and Down syndrome, confounded by maternal age). Control by randomisation, restriction, matching, stratification or adjustment.
The two-by-two table
| Test | Disease present | Disease absent |
|---|---|---|
| Positive | a (true positive) | b (false positive) |
| Negative | c (false negative) | d (true negative) |
Every test measure comes from these four cells:
| Measure | Formula | Reads down or across |
|---|---|---|
| Sensitivity | a/(a+c) | Down the diseased column |
| Specificity | d/(b+d) | Down the healthy column |
| Positive predictive value | a/(a+b) | Across the positive row |
| Negative predictive value | d/(c+d) | Across the negative row |
| Accuracy | (a+d)/total | Whole table |
- Sensitivity + false-negative rate = 100%; specificity + false-positive rate = 100%.
- SnNOut: a sensitive test, when negative, rules out. SpPIn: a specific test, when positive, rules in. Screen with sensitive tests, confirm with specific ones.
- Prevalence moves predictive values: as a disease becomes more common, PPV rises and NPV falls; sensitivity and specificity do not change. Predictive values cannot be carried unchanged to another population.
- Likelihood ratios: LR+ = sensitivity ÷ (1 − specificity); LR− = (1 − sensitivity) ÷ specificity. Independent of prevalence; pre-test odds × LR = post-test odds.
- Cut-off: lowering the positive threshold raises sensitivity and lowers specificity. The ROC curve plots sensitivity against 1 − specificity; area 0.5 is chance, 1.0 perfect.
- A test can show high accuracy simply because most people tested are healthy.
Worked examples
| Data | Calculation | Answer |
|---|---|---|
| 90 TP, 10 FN, 30 FP, 170 TN | PPV = 90 ÷ (90 + 30) | 75% |
| 1,000 tested: 100 diseased (90 positive); 900 healthy (90 positive) | PPV = 90 ÷ 180 | 50% |
| Positive in 80 with disease and 20 without | PPV = 80 ÷ 100 | 80% (not sensitivity) |
| 102 of 120 women with GDM had a positive challenge test | Sensitivity = 102 ÷ 120 | 85% |
| 500 negative fibronectin tests, 495 did not deliver | NPV = 495 ÷ 500 | 99% |
| 90 TP, 10 FN, 50 FP, 350 TN | Accuracy = 440 ÷ 500 | 88% |
| Sensitivity 90%, specificity 80% | LR+ = 0.9 ÷ 0.2 | 4.5 |
Measures of frequency
- Incidence = new cases ÷ population at risk over a period. Exclude people who already have the disease: if 96 of 1,200 women with a normal booking test develop gestational diabetes, cumulative incidence is 8%.
- Prevalence = all existing (old + new) cases ÷ population. Prevalence ≈ incidence × duration: incidence 10 per 1,000 per year lasting 5 years gives a prevalence of about 50 per 1,000. A drug that prolongs life without cure raises prevalence.
Measures of risk and effect
| Measure | Formula | Example |
|---|---|---|
| Relative risk (RR) | Risk exposed ÷ risk unexposed (cohort, RCT) | 30 ÷ 3 per 1,000 = 10 |
| Odds ratio (OR) | ad ÷ bc (case–control) | Cases 40 exposed, 60 not; controls 20 exposed, 80 not: (40 × 80) ÷ (60 × 20) = 2.67 |
| Attributable risk (AR) | Risk exposed − risk unexposed | 30 − 3 = 27 per 1,000 |
| AR per cent | AR ÷ risk in exposed | SGA 15% in smokers vs 5%: 10 ÷ 15 = 67% |
| Absolute risk reduction (ARR) | Control risk − treated risk | 15% − 9% = 6% |
| Relative risk reduction (RRR) | ARR ÷ control risk (or 1 − RR) | 6 ÷ 15 = 40% |
| Number needed to treat (NNT) | 1 ÷ ARR, rounded up | 1 ÷ 0.06 = 17 |
- An RR or OR of 1 means no association. The OR approximates the RR when the disease is rare.
- A large RRR can hide a tiny absolute benefit when the outcome is rare; advertisements quote RRR because it sounds bigger.
- AR per cent applies to the exposed group; population attributable risk also depends on how common the exposure is.
Screening
- Main objective: detect disease at an early, treatable stage to reduce death or morbidity (secondary prevention).
- Wilson–Jungner criteria: important problem; recognisable latent or early stage; natural history understood; acceptable, valid test; effective treatment for early disease; cost-effective. Cervical cytology fits; CA-125 for ovarian cancer does not.
- Breast screening: mammography for women from about 50 years; under 35, ultrasound is the first test for a lump because dense breasts hide lesions.
- Mass screening tests everyone; selective targets high-risk groups (higher yield); opportunistic happens when patients attend. In antenatal serum screening, oestriol is part of the triple test.
Chance
- p value: probability of a result at least this extreme if the null hypothesis is true; below 0.05 is called significant. It does not measure effect size.
- Type I error (alpha): false positive. Type II error (beta): missing a real effect; power = 1 − beta, raised by larger samples.
- 95% confidence interval: the likely range of the true value. For ratios an interval including 1 is not significant; for differences, one including 0.
- Standard deviation describes spread of values; standard error the precision of a mean. Chi-square tests association between categories.
Remember Prevalence moves the predictive values; it never moves sensitivity or specificity.
Exam trap The odds ratio comes from case–control studies, the relative risk from cohort studies; do not swap them.
Exam trap For LR+, divide sensitivity by the false-positive rate, not by specificity.
How FCPS asks about this
- Mothers of malformed babies recall drugs better: recall bias.
- PPV from a table: true positives ÷ all positives.
- Disease becomes more common: PPV rises, NPV falls.
- Prevalence from incidence: incidence × average duration.
- Funnel plot: detects publication bias.
- Cox regression result: hazard ratio.
- New drug shown "not worse by more than a margin": non-inferiority trial.
Test yourself on this topic
5 of the 114 questions in our bank on this topic. Choose an answer to see why every option is right or wrong.
A 50-g glucose challenge test is evaluated in an antenatal clinic. Of 120 women later confirmed by OGTT to have gestational diabetes, 102 had a positive challenge test. What is the sensitivity of the challenge test?
Answer: 85%
Sensitivity is the proportion of people with the disease who test positive: true positives divided by all who have the disease. Here it is 102/120 = 85%. The remaining 15% are false negatives. Sensitivity is calculated only from the people who have the disease, so the number of women without diabetes is not needed.
Sensitivity
- TP ÷ (TP + FN)
- Uses only the diseased
- Here 102 ÷ 120 = 85%
- High sensitivity rules out (SnOut)
Remember Sensitivity looks only at those who have the disease.
Exam trap Sensitivity and false-negative rate always add up to 100%.
Why the other options are wrong
- 15% This is the false-negative rate.
- 102% A proportion cannot exceed 100%.
- 54% Not derived from these numbers.
- 98% Not derived from these numbers.
A screening test for a fetal condition has a sensitivity of 90% and a specificity of 95%. It is offered to 10,000 low-risk pregnant women in whom the condition has a prevalence of 1%. Approximately what is the positive predictive value of the test in this population?
Answer: About 15%
Of 10,000 women, 100 have the condition and 90 of them test positive (true positives). Of the 9,900 without it, 5% (495) test positive (false positives). The positive predictive value is 90 ÷ (90 + 495) = about 15%. Even a good test has a low PPV when the condition is rare, because false positives from the large healthy group outnumber the true positives.
PPV and prevalence
- TP = 90, FP = 495
- PPV = 90 ÷ 585 ≈ 15%
- Low prevalence: low PPV
- NPV stays very high
Remember Rare disease, many false alarms.
Exam trap Sensitivity and specificity do not tell a woman her chance of being affected after a positive result; PPV does.
Why the other options are wrong
- About 90% This is the sensitivity.
- About 95% This is the specificity.
- About 50% Would need a much higher prevalence.
- About 99% Close to the negative predictive value, not PPV.
In an antenatal clinic, 1,200 women have a normal glucose test at booking. By 32 weeks, 96 of them have developed gestational diabetes. What is the cumulative incidence of gestational diabetes in this group?
Answer: 8%
Cumulative incidence (risk) is the number of new cases during a period divided by the number of people at risk at the start of that period. Here it is 96 ÷ 1,200 = 0.08, or 8%, between booking and 32 weeks. Only women free of the condition at the start are counted in the denominator, which is why the booking test matters.
Cumulative incidence
- New cases ÷ population at risk
- Over a stated period
- Here 96 ÷ 1,200 = 8%
- Denominator: disease-free at start
Remember Incidence counts only new cases among those at risk.
Exam trap Including women who already had diabetes at booking would inflate the denominator and distort incidence.
Why the other options are wrong
- 9.6% Treats 96 as a percentage of 1,000.
- 12.5% Inverts the calculation (1,200 ÷ 96).
- 0.8% Misplaces the decimal point.
- 1.2% Uses the denominator as the numerator.
Eight young women with clear cell adenocarcinoma of the vagina are compared with 32 matched women without the tumour, and their mothers' use of diethylstilboestrol in pregnancy is obtained from records. Which measure of association should be calculated?
Answer: Odds ratio
This is a case–control study: participants are selected by outcome (the tumour) and their past exposure is compared. Because the investigators fix the numbers of cases and controls, incidence cannot be measured, so relative risk and attributable risk cannot be calculated directly. The odds ratio, the odds of exposure in cases divided by that in controls, is used, and it approximates relative risk when the disease is rare.
Case–control measure
- Select by outcome
- Look back at exposure
- Measure: odds ratio
- Ideal for rare diseases
Remember Case–control gives odds, not risks.
Exam trap The odds ratio approximates the relative risk only when the outcome is rare.
Why the other options are wrong
- Relative risk Needs incidence, which a case–control study cannot give.
- Incidence rate Needs a followed population at risk.
- Attributable risk Needs incidence in exposed and unexposed.
- Prevalence ratio Comes from cross-sectional studies.
Cytology-based screening has reduced deaths from cervical cancer, while screening with CA-125 and ultrasound has not clearly reduced deaths from ovarian cancer. Which feature of cervical cancer mainly makes screening for it effective?
Answer: A long detectable pre-invasive phase
A key screening criterion is a recognisable latent or early stage. Cervical cancer develops over many years through cervical intraepithelial neoplasia, which can be detected by cytology or HPV testing and treated easily before invasion. Most high-grade serous ovarian cancers have no long detectable precursor stage in an accessible site, so screening tends to find them already advanced. Incidence alone does not make screening effective.
Why cervical screening works
- Long pre-invasive phase (CIN)
- Simple, acceptable test
- Effective treatment of precursors
- Fits Wilson–Jungner criteria
Remember Screening works best when there is a long, treatable early stage.
Exam trap Screening a disease without a detectable early phase mostly finds late disease and adds harm.
Why the other options are wrong
- A higher incidence than ovarian cancer Incidence alone does not make screening work.
- A worse prognosis once invasive Prognosis of invasive disease is not the reason.
- A lower cost of treatment Cost is not the main reason.
- A stronger genetic tendency Most cervical cancers are HPV-related, not hereditary.
Where this sits in the CPSP syllabus
- Obstetrics & Gynaecology, Paper 2: Statistics and epidemiology, Study designs, screening test validity, risk and chance