Thursday 6 July 2017

From Binomial to Poisson

There's nothing special about this post. Once again, I'm practising my LaTeX skills and reminding myself at the same time of the connection between the Binomial and Poisson probability distributions. Let's start with a binomial distribution with number of trials \( n \) and probability of success \( \lambda/n \). Let's say that \( n \) is the number of equal intervals into which a unit of time has been divided. The unit of time might be one hour and this interval is divided into 10 equal intervals each of 6 minutes duration. Suppose that there are on average 7 calls during the hour. The probability of a call being received during any one of the intervals is thus 7/10 or 0.7.

Suppose X is a random variable that is binomially distributed with probability of success \( \lambda/n \) and number of trials \( n \), that is \(X \sim B(n, \lambda/n) \). The probability that X takes a special value \( x \) is then given by:\[ P(X=x)=\binom{n}{x} \left( \frac{ \lambda}{n} \right)^x \left( 1-\frac{\lambda}{n} \right)^{n-x} \]This can be written as:\[ P(X=x)=\frac{n(n-1)(n-2) ... (n-x+1)}{x!} \times \frac{\lambda^x}{n^x}\left(1-\frac{\lambda}{n} \right)^{n-x} \]Again, this can be rearranged to:\[ P(X=x)=\frac{\lambda^x}{x!} \times \frac{n-1}{n} \times \frac{n-2}{n} \times ... \times \frac{n-x+1}{n} \times \left(1-\frac{\lambda}{n} \right)^{n-x} \]An \( n  \to \infty \), the expression becomes: \[P(X=x)=\frac{\lambda^x}{x!}e^{-\lambda} \]This formula then represents the Poisson distribution, a suitable model for events which:

  • occur randomly in space or time
  • occur singly, that is events cannot occur simultaneously
  • occur independently
  • occur at a constant rate, that is a mean number of events in a given time interval is proportional to the size of the interval

A discrete random variable that follows a Poisson distribution with parameter \( \lambda \) is written as \(X \sim Po(\lambda) \) and the mean of this distribution is \( \lambda \) and the variance is also \( \lambda \). Thus the mean and variance of a Poisson distribution are equal.

In Google Sheets, the syntax for the Poisson distribution function is shown below: