Skip to main content

Explain

Intuition

When we have a collection of independent events (like flipping the same coin multiple times), the chance of all those specific outcomes happening exactly as they did is just the product of their individual chances.

Think about a coin flip where the probability of heads (x=1x=1) is π\pi, and the probability of tails (x=0x=0) is (1π)(1-\pi).

If you flip the coin nn times, and get ss heads, it means you must have gotten nsn - s tails.

Since each flip is independent, the probability of getting exactly that sequence of heads and tails is simply π\pi multiplied by itself ss times, and (1π)(1-\pi) multiplied by itself nsn-s times.

This gives us πs(1π)ns\pi^s (1-\pi)^{n-s}. The sum ss perfectly summarizes everything we need to know from the data to estimate π\pi; we don't need to know the exact order of heads and tails, just the total count. This makes ss a "sufficient statistic".