Mathwords logoMathwords

Simpson's Paradox — Definition, Formula & Example

Simpson's Paradox is what happens when one group does better in every separate category but worse once all the categories are combined. The reversal usually comes from a lurking variable that changes how the groups are split up.

Let ZZ be a categorical variable with levels z1,…,zkz_1, \dots, z_k. Simpson's Paradox occurs when P(S∣A,Z=zi)>P(S∣B,Z=zi)P(S \mid A, Z = z_i) > P(S \mid B, Z = z_i) for every level ziz_i, yet P(S∣A)<P(S∣B)P(S \mid A) < P(S \mid B) for the aggregated data. This is possible because each aggregated rate is a weighted average of the subgroup rates, and AA and BB can have different weights.

Key Formula

poverall=n1p1+n2p2n1+n2p_{\text{overall}} = \frac{n_1 p_1 + n_2 p_2}{n_1 + n_2}
Where:
  • p1,p2p_1, p_2 = Success rates within subgroup 1 and subgroup 2
  • n1,n2n_1, n_2 = Number of cases in each subgroup, which act as the weights
  • poverallp_{\text{overall}} = Combined success rate across both subgroups

Worked Example

Problem: Two surgeons each perform 100 operations. Dr. A: 18 of 20 easy cases succeed and 32 of 80 hard cases succeed. Dr. B: 68 of 80 easy cases succeed and 7 of 20 hard cases succeed. Who has the better success rate?
Step 1: Compare the surgeons within the easy cases.
A: 1820=0.90B: 6880=0.85\text{A: } \frac{18}{20} = 0.90 \qquad \text{B: } \frac{68}{80} = 0.85
Step 2: Compare them within the hard cases. Dr. A wins again.
A: 3280=0.40B: 720=0.35\text{A: } \frac{32}{80} = 0.40 \qquad \text{B: } \frac{7}{20} = 0.35
Step 3: Combine the categories. The comparison flips. Dr. A took mostly hard cases (80 of 100), so the low hard-case rate gets most of the weight in Dr. A's overall rate.
A: 18+32100=0.50B: 68+7100=0.75\text{A: } \frac{18 + 32}{100} = 0.50 \qquad \text{B: } \frac{68 + 7}{100} = 0.75
Answer: Dr. A has the higher success rate for both easy and hard cases, but Dr. B has the higher overall rate (75% vs. 50%). Case difficulty is the lurking variable. Dr. A has the higher observed success rate at each difficulty level.

Visualization

Why It Matters

Simpson's Paradox appears in two-way-table questions like those on AP Statistics, where you must explain how a lurking variable reverses a comparison. Medical researchers, college admissions analysts, and sports statisticians check for it before ranking treatments, departments, or players based on combined percentages.

Common Mistakes

Mistake: Trusting the combined percentage without checking how each group is distributed across the categories.
Correction: Look at the subgroup counts. If one group has far more cases in a hard or low-success category, its overall rate is pulled down by weighting rather than worse performance. Compare within each level of the lurking variable.

Related Terms