Strong Law of Large Numbers

Probability · Axiom Academy

LESSON Strong Law of Large Numbers Almost sure convergence and its powerful implications Let X₁, X₂, X₃, ... be i.i.d. random variables with mean μ and define the sample mean as before: The Strong Law of Large Numbers states: The notation "a.s." stands for "almost surely," meaning with probability 1. This is stronger than convergence in probability! What's the difference between these two types of convergence? For each fixed n, the probability of large deviation goes to zero. The entire sequence converges to μ with probability 1. Key insight: The Strong Law is indeed stronger: almost sure convergence always implies convergence in probability, but not vice versa. 3. Implications and Applications The Strong Law has profound implications for statistics and data science: Empirical frequencies: If you repeat an experiment infinitely many times, the observed frequency will equal the true probability (almost surely) Monte Carlo methods: We can estimate expected values by averaging random samples, with convergence guaranteed Statistical estimation: Sample moments converge to population moments as we collect more data Machine learning: Training on larger datasets yields estimates closer to true parameters

This is the written version of the interactive lesson above. See the full Probability course.