ProbabilityInequalities and Limit Theorems

The Normal Approximation to the Binomial

Approximate Binomial(n, p) with a normal curve, widening each whole number to an interval of width 1: P(X ≤ 12) ≈ P(Y < 12.5).

Not started Jump to practice

A binomial count is a sum of independent 0–1 trials, so by the central limit theorem it is close to normal when $n$ is large. But the binomial lives on whole numbers and the normal curve on all real numbers. The continuity correction bridges the two.

Key idea

For $X$ binomial with $np(1 - p)$ reasonably large (say at least 10), use $Y$ normal with mean $np$ and standard deviation $\sqrt{np(1 - p)}$, and widen each whole number $k$ to $[k - 0.5,\ k + 0.5]$: $$P(X \le k) \approx P(Y < k + 0.5), \qquad P(X \ge k) \approx P(Y > k - 0.5), \qquad P(X = k) \approx P(k - 0.5 < Y < k + 0.5).$$

Why it works

Draw the binomial pmf as bars of width 1, centered on the whole numbers. The bar for $k$ covers $[k - 0.5, k + 0.5]$ and its area is $P(X = k)$. The normal curve approximates the tops of the bars, so the area under the curve over the same stretch approximates the same probability. For $X \le k$ the bars run through the one at $k$, which ends at $k + 0.5$. Without the correction, a single value would get probability 0, and each "$\le$" question would lose half a bar.
The normal curve for 100 fair coin flips: the area to the left of 45.5 approximates the chance of at most 45 heads.
First decide which whole numbers are in, then go half a unit past the last one.
EventCorrected normal event
$X \le 45$$Y < 45.5$
$X < 45$, which is $X \le 44$$Y < 44.5$
$X \ge 45$$Y > 44.5$
$X > 45$, which is $X \ge 46$$Y > 45.5$
$X = 45$$44.5 < Y < 45.5$

Worked examples

Worked example: At most 45 heads

Flip a fair coin 100 times. Approximate $P(X \le 45)$. Use $\Phi(-0.9) = 0.1841$.
  1. $np = 50$ and $\sqrt{np(1 - p)} = 5$.
  2. $P(X \le 45) \approx P(Y < 45.5)$; $z = \frac{45.5 - 50}{5} = -0.9$.
  3. $\approx 0.1841$. The exact binomial value is $0.1841$ too.

Answer: about $0.184$

Worked example: Fewer than 45

Same coin. Approximate $P(X < 45)$. Use $\Phi(-1.1) = 0.1357$.
  1. $X < 45$ means $X \le 44$, so use $Y < 44.5$.
  2. $z = \frac{44.5 - 50}{5} = -1.1$, and $P \approx 0.1357$ (exact: $0.1356$).

Answer: about $0.136$

Worked example: Exactly 50

Approximate $P(X = 50)$. Use $\Phi(0.1) = 0.5398$.
  1. $P(X = 50) \approx P(49.5 < Y < 50.5)$, with $z = \pm 0.1$.
  2. $\approx 0.5398 - 0.4602 = 0.0796$ (exact: $0.0796$).

Answer: about $0.080$

Common mistake

Skipping the correction, or moving the boundary the wrong way. $P(X < 12)$ is $P(X \le 11)$, so the boundary is $11.5$, not $12.5$. Check: list which whole numbers the event includes, and make the normal interval run half a unit beyond the extreme ones.

Practice

Pass with 3 right answers, the last 2 in a row. Each right answer earns 2 XP.

Loading practice…

Builds on

Leads to

This is one of the top rungs of Probability.

Sources and further reading

  • Grinstead and Snell, Introduction to Probability (2nd revised edition, American Mathematical Society; free from Dartmouth College), chapter 9 (Central Limit Theorem), section 9.1, Bernoulli trials
  • MIT OpenCourseWare 18.05, Introduction to Probability and Statistics (Spring 2014), readings on the normal approximation to the binomial
@teddyrookbook GitHub