Moments and Moment Generating Functions

Probability · Axiom Academy

LESSON Moments and Moment Generating Functions Advanced tools for characterizing probability distributions The kth moment of a random variable X is the expected value of X raised to the kth power. • 1st moment: E[X] = μ (the mean) • 2nd moment: E[X²] (used to compute variance) • Higher moments describe shape: skewness (3rd), kurtosis (4th) The MGF of a random variable X is a function that generates all moments when differentiated. The MGF is defined for values of t where the sum converges. It uniquely determines the distribution: if two random variables have the same MGF, they have the same distribution. The power of the MGF is that moments can be found by taking derivatives and evaluating at t = 0. Key Formula: E[X k ] = M (k) (0), where M (k) is the kth derivative of M. • E[X] = M'(0) (first derivative at 0) • E[X²] = M''(0) (second derivative at 0) This turns difficult summation problems into easier calculus problems!

This is the written version of the interactive lesson above. See the full Probability course.