ProbabilityContinuous Random Variables

The Poisson Process

For random arrivals at rate λ, the count in a window of length t is Poisson with mean λt, and the gaps between arrivals are exponential with mean 1/λ.

Not started Jump to practice

The Poisson distribution counts random events in a window; the exponential distribution measures the wait between them. They are two views of the same model, the Poisson process: arrivals scattered in time at a steady rate, with no memory.

Key idea

In a Poisson process with rate $\lambda$: the number of arrivals in any window of length $t$ is Poisson with mean $\lambda t$; counts in non-overlapping windows are independent; and the gaps between arrivals are independent exponential times with mean $\frac{1}{\lambda}$. The $k$th arrival comes after an expected $\frac{k}{\lambda}$.

Why it works

Start the clock at any moment. The first arrival comes after time $t$ exactly when the window $[0, t]$ holds no arrivals, so $$P(\text{first wait} > t) = P(N(t) = 0) = e^{-\lambda t}:$$ the wait is exponential with rate $\lambda$. Because separate windows are independent, the same argument restarts after every arrival, so every gap is exponential and the gaps are independent. The time to the $k$th arrival is the sum of $k$ gaps, with mean $\frac{k}{\lambda}$ by linearity.
Arrivals at rate 2 per unit of time. The gaps between them form a histogram that follows the exponential density with mean one half.

Worked examples

Worked example: Counts in a window

Customers arrive as a Poisson process at 6 per hour. Find the probability of exactly 2 arrivals in 20 minutes.
  1. 20 minutes is $\frac{1}{3}$ hour, so the mean count is $\lambda t = 6 \cdot \frac{1}{3} = 2$.
  2. $$P(N = 2) = e^{-2}\frac{2^{2}}{2!} = 2e^{-2} \approx 0.271$$

Answer: about $0.271$

Worked example: Waiting

With the same process, find the probability that nobody arrives in the next 15 minutes, and the expected wait for the 3rd customer.
  1. No arrivals in $\frac{1}{4}$ hour: $e^{-6/4} = e^{-1.5} \approx 0.223$.
  2. Each gap has mean $\frac{1}{6}$ hour = 10 minutes, so the 3rd arrival is expected after 30 minutes.

Answer: about $0.223$; 30 minutes.

Worked example: Given the total

Exactly 4 customers arrived during one hour. Find the probability that exactly 1 of them came in the first 15 minutes.
  1. Given the total, the 4 arrival times behave like 4 independent uniform points in the hour.
  2. Each lands in the first quarter-hour with probability $\frac{1}{4}$, so the count there is binomial.
  3. $\binom{4}{1}\left(\frac{1}{4}\right)\left(\frac{3}{4}\right)^{3} = \frac{27}{64} \approx 0.422$. The rate 6 dropped out.

Answer: $\frac{27}{64}$

Common mistake

Giving the count in a window of length $t$ the mean $\lambda$ instead of $\lambda t$, or giving the gaps the mean $\lambda$ instead of $\frac{1}{\lambda}$. Check: a higher rate means more arrivals and shorter gaps, so the count's mean grows with $\lambda$ and the gap's mean shrinks.

Practice

Pass with 3 right answers, the last 2 in a row. Each right answer earns 3 XP.

Loading practice…

Builds on

Leads to

This is one of the top rungs of Probability.

Sources and further reading

  • Grinstead and Snell, Introduction to Probability (2nd revised edition, American Mathematical Society; free from Dartmouth College), chapter 5 (Distributions and Densities), section 5.2, the exponential density and the Poisson process
  • MIT OpenCourseWare 18.440, Probability and Random Variables (Spring 2014), lecture notes on Poisson processes
@teddyrookbook GitHub