ProbabilityDiscrete Random Variables

Choosing a Distribution

Match the story to binomial, geometric, negative binomial, hypergeometric or Poisson.

Not started Jump to practice

Most word problems in this unit are solved the moment the right model is named. This lesson collects the hypergeometric, negative binomial and Poisson models with the binomial and geometric, and gives a short set of questions for telling them apart.

Key idea

Ask in order: Is there a fixed number of draws without replacement from a finite group? Hypergeometric. A fixed number $n$ of independent trials with the same $p$, counting successes? Binomial. Trials until the first success? Geometric. Until the $r$th? Negative binomial. Events at random at a steady rate in time or space, with no fixed number of trials? Poisson.

Why it works

Each model is the exact answer for its story, and each formula uses the story's features. The binomial's $\binom{n}{k}p^{k}(1 - p)^{n - k}$ needs independence and a constant $p$; without replacement those fail, and counting subsets replaces them. The waiting-time models fix the number of successes and let the number of trials vary; the binomial does the opposite. The Poisson is the limit of many tiny independent chances. Using a model whose story does not fit gives a precise-looking wrong answer.
The five discrete models of this unit.
ModelStory$P(X = k)$MeanVariance
Binomial$n$ independent trials, count successes$\binom{n}{k}p^{k}(1 - p)^{n - k}$$np$$np(1 - p)$
Geometrictrials until the first success$(1 - p)^{k - 1}p$$\frac{1}{p}$$\frac{1 - p}{p^{2}}$
Negative binomialtrials until the $r$th success$\binom{k - 1}{r - 1}p^{r}(1 - p)^{k - r}$$\frac{r}{p}$$\frac{r(1 - p)}{p^{2}}$
Hypergeometric$n$ draws without replacement, $K$ of $N$ special$\frac{\binom{K}{k}\binom{N - K}{n - k}}{\binom{N}{n}}$$\frac{nK}{N}$$n\frac{K}{N}\frac{N - K}{N}\frac{N - n}{N - 1}$
Poissonrandom events at a steady rate$e^{-\lambda}\frac{\lambda^{k}}{k!}$$\lambda$$\lambda$

Worked examples

Worked example: A card hand

Five cards are dealt from a shuffled deck. $X$ is the number of hearts. Which model, and what is $E[X]$?
  1. A fixed number of draws without replacement from 52 cards, 13 of them hearts: hypergeometric.
  2. $E[X] = 5 \cdot \frac{13}{52} = \frac{5}{4}$.

Answer: Hypergeometric, mean $\frac{5}{4}$.

Worked example: Waiting for sixes

Roll a die until the third six. $X$ is the number of rolls. Which model, and what is $E[X]$?
  1. Independent trials, same $p = \frac{1}{6}$, until the 3rd success: negative binomial with $r = 3$.
  2. $E[X] = \frac{3}{1/6} = 18$.

Answer: Negative binomial, mean 18.

Worked example: Two counts that look alike

(a) The number of earthquakes above magnitude 5 in a region in a year. (b) The number of defective items in a sample of 10 from a shipment of 100,000. Which models?
  1. (a) Events at random times at a steady average rate, no fixed number of trials: Poisson.
  2. (b) Strictly hypergeometric, but 10 draws from 100,000 barely change the mix, so binomial with $n = 10$ is an excellent approximation.

Answer: Poisson; binomial (as an approximation to the hypergeometric).

Common mistake

Reaching for the binomial whenever the word "success" appears. Before using it, check all four conditions: a fixed number of trials, two outcomes, independence, and the same $p$ every time. A question that says "until" has a random number of trials; one that says "without replacement" from a small group breaks independence.

Practice

Pass with 3 right answers, the last 2 in a row. Each right answer earns 2 XP.

Loading practice…

Builds on

Leads to

This is one of the top rungs of Probability.

Sources and further reading

  • Grinstead and Snell, Introduction to Probability (2nd revised edition, American Mathematical Society; free from Dartmouth College), chapter 5 (Distributions and Densities), section 5.1, important distributions
  • MIT OpenCourseWare 18.05, Introduction to Probability and Statistics (Spring 2014), readings on a gallery of discrete distributions
@teddyrookbook GitHub