False Positive Paradox — Definition, Formula & Example
The false positive paradox is the surprising fact that a very accurate test can produce positive results that are mostly wrong. This happens when the thing being tested for is rare.
Let be an event with prior probability , and let a test have sensitivity and false positive rate . The paradox is that can be small even when is close to 1 and is close to 0. In fact, exactly when , which happens whenever the base rate is small compared with .
Key Formula
Where:
- = Base rate, the prior probability that the condition is present
- = Sensitivity, the probability of a positive result when the condition is present
- = False positive rate, the probability of a positive result when the condition is absent
- = Likelihood ratio, which says how strongly a positive result favors the condition
Worked Example
Problem: A bank's fraud detector flags 99% of fraudulent card transactions and wrongly flags 1% of legitimate ones. Group A is every transaction the bank processes, and 1 in 10,000 of them is fraud. Group B is only transactions that customers have reported as suspicious, and 1 in 10 of them is fraud. In each group, what is the probability that a flagged transaction is really fraud?
Step 1: Find the likelihood ratio. It is the same detector in both groups, so a flag multiplies the odds of fraud by the same factor each time.
Step 2: Group A has prior odds of 1 to 9,999. Multiply by 99, then convert the odds back to a probability.
Step 3: Group B has prior odds of 1 to 9. The same factor of 99 now produces strong evidence.
Answer: In Group A, a flagged transaction is fraud only about 1% of the time. In Group B, it is fraud about 92% of the time. The detector is identical in both groups. Only the base rate changed, and that alone makes a flag nearly meaningless in one group and highly reliable in the other.
Why It Matters
AP Statistics questions on conditional probability can give a test's accuracy rates and ask for the probability of a condition given a positive result. The paradox is also why doctors confirm a positive screening result with a second, independent test, and why screening is usually aimed at higher-risk groups instead of the whole population.
Common Mistakes
Mistake: Reading "the test catches 99% of cases" as "99% of positive results are correct."
Correction: The first statement is and the second is . These are different conditional probabilities. To get you must use the base rate, through Bayes' theorem or the odds form above.
