Moment Generating Functions

College Depth 64 in the knowledge graph I know this Set as goal
mgf moments

Core Idea

MGF M(t)=E[e^{tX}] uniquely determines a distribution (when it exists). The n-th moment is M^{(n)}(0)=E[X^n]. MGFs simplify finding moments, proving distribution properties, and establishing convergence. Matching MGFs implies identical distributions.

Explainer

A moment generating function (MGF) is a compact device that encodes every moment of a random variable into a single function. To see where it comes from, recall the Taylor series for e^u: e^u = 1 + u + u²/2! + u³/3! + ⋯ Substituting u = tX gives e^{tX} = 1 + tX + t²X²/2! + t³X³/3! + ⋯ Taking expectations term by term yields M(t) = E[e^{tX}] = 1 + tE[X] + t²E[X²]/2! + t³E[X³]/3! + ⋯ Every coefficient carries a moment. The MGF is literally the generating function of the sequence of moments — the name is apt.

The key computational payoff is that differentiation at zero extracts moments. Differentiating M(t) once and evaluating at t=0 gives M'(0) = E[X]. Differentiating twice gives M''(0) = E[X²]. You already know variance from prerequisites: Var(X) = E[X²] − (E[X])². The MGF lets you compute both quantities from a single function by taking derivatives, rather than computing integrals from scratch. For a Poisson(λ) random variable, for example, M(t) = e^{λ(e^t - 1)}, and two differentiations at zero confirm E[X] = Var(X) = λ.

MGFs also shine when working with sums of independent random variables. If X and Y are independent, then M_{X+Y}(t) = E[e^{t(X+Y)}] = E[e^{tX}]·E[e^{tY}] = M_X(t)·M_Y(t). Products of MGFs correspond to convolutions of distributions — a statement that would require integral calculations to prove directly. This multiplicative property is what allows the MGF proof of the Central Limit Theorem: as sums of independent copies are taken, their MGFs converge to the MGF of the normal distribution, and since MGFs uniquely determine distributions, the sum converges in distribution to normal.

The uniqueness theorem is what gives MGFs their real power: if two random variables have the same MGF on an open interval around zero, they have the same distribution. This means you can prove distributional equalities by comparing MGFs rather than density functions. There is one important caveat: the MGF does not always exist. If E[e^{tX}] = ∞ for all t ≠ 0 (as happens for heavy-tailed distributions like the Cauchy), the MGF fails to exist and one must use the characteristic function φ(t) = E[e^{itX}] instead, which always exists since |e^{itX}| = 1. Characteristic functions have analogous properties but require complex analysis — a reason to appreciate MGFs when they do exist.

Practice Questions 5 questions

Prerequisite Chain

Counting to 10Counting to 20Understanding ZeroThe Number ZeroCounting to FiveOne-to-One CorrespondenceCombining Small Groups Within 5Addition Within 10Addition Within 20Two-Digit Addition Without RegroupingTwo-Digit Addition with RegroupingAddition Within 100Repeated Addition as MultiplicationMultiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Two-Digit by One-Digit DivisionDivision with RemaindersRemainders and Quotients in DivisionDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueIntegers and the Number LineOpposites and Additive InversesAbsolute ValueAdding IntegersSubtracting IntegersMultiplying IntegersDividing IntegersUnit RatesProportionsPercent ConceptConverting Between Fractions, Decimals, and PercentsOperations with Rational NumbersTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesLiteral EquationsSlope-Intercept FormPoint-Slope FormWriting Linear EquationsParallel and Perpendicular Line SlopesGraphing Linear EquationsPiecewise FunctionsStep FunctionsComposition of FunctionsInverse FunctionsRadical Functions and GraphsRational ExponentsExponential Functions and GraphsLogarithms IntroductionLogarithm PropertiesSolving Logarithmic EquationsNatural Logarithm and eMoment Generating Functions

Longest path: 65 steps · 252 total prerequisite topics

Prerequisites (2)

Leads To (0)

No topics depend on this one yet.