A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Introduction to Martingales

Research Depth 96 in the knowledge graph ☐ I know this ☆ Set as goal
19topics build on this
523prerequisites beneath it
See this on the map →
Conditional ExpectationMarkov Chains→→Branching ProcessesBrownian Motion and the Wiener Process+5 more
martingales stochastic-processes probability

Core Idea

A sequence {Mₙ} is a martingale if E[Mₙ₊₁ | ℱₙ] = Mₙ almost surely, where ℱₙ is the sigma-algebra of information up to time n. Martingales have zero expected change given current information—they are 'fair games.' The optional stopping theorem, martingale convergence theorem, and inequalities (Doob, Markov) are powerful tools for analyzing random processes.

Explainer

A martingale formalizes the idea of a "fair game." Imagine a gambler whose fortune after n rounds is Mₙ. In a fair game, no matter what has happened so far, your best prediction for your fortune tomorrow is your fortune today: E[M_{n+1} | everything up to now] = Mₙ. This is precisely the martingale condition. Your prerequisite, conditional expectation, is exactly the tool that gives meaning to "expected value given current information." The filtration ℱₙ is just the mathematical object representing "everything knowable up to time n" — the sigma-algebra generated by M₁, M₂, …, Mₙ.

The simplest example is a symmetric random walk: a player wins or loses $1 on each fair coin flip. If Mₙ is the player's wealth, then E[M_{n+1} | ℱₙ] = (1/2)(Mₙ+1) + (1/2)(Mₙ-1) = Mₙ. The walk is a martingale. A supermartingale satisfies E[M_{n+1} | ℱₙ] ≤ Mₙ — the process tends to decrease (like a gambler at a casino with a house edge). A submartingale satisfies ≥ — the process tends to increase. Many important processes are martingales after appropriate centering: Sₙ - n·μ (a random walk minus its drift), or M²ₙ - n·σ² (the square of a centered walk minus a correcting term). Recognizing and constructing martingales from known processes is a core skill.

The connection to Markov chains (your soft prerequisite) is informative: every Markov chain generates martingales through harmonic functions. If h satisfies h(x) = Σ P(x,y)h(y) for all states x, then h(Xₙ) is a martingale. This bridges the two frameworks and lets you use martingale tools to analyze hitting times and absorption probabilities in Markov chains.

The power of the martingale framework lies in its theorems. The optional stopping theorem says E[M_T] = E[M₀] for a bounded stopping time T — you cannot gain an expected advantage by deciding when to stop a fair game, no matter how clever your stopping rule. The martingale convergence theorem says that a martingale bounded in L¹ converges almost surely to a limit — the fair game eventually settles. Doob's maximal inequality and Doob's Lp inequality provide moment and tail bounds on the supremum of a martingale, analogous to Markov's inequality but much sharper. Together, these make martingales the central tool in modern probability theory for proving convergence results, analyzing algorithms, and bounding stochastic processes.

Practice Questions 5 questions

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Number Bonds to 10 → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Dividing Integers → Unit Rates → Proportions → Percent Concept → Converting Between Fractions, Decimals, and Percents → Operations with Rational Numbers → Two-Step Equations → Solving Multi-Step Equations → Equations with Variables on Both Sides → Angle Pairs: Complementary, Supplementary, and Vertical → Parallel Lines and Transversals → Corresponding Angles → Alternate Interior Angles → Triangle Angle Sum Theorem → Exterior Angle Theorem → Triangle Inequality Theorem → Similar Triangles: AA Similarity → Similar Triangles: SSS and SAS Similarity → Proportions in Similar Triangles → Right Triangle Trigonometry Introduction → Sine, Cosine, and Tangent Ratios → Trigonometric Ratios Review → Radian Measure → Converting Between Degrees and Radians → The Unit Circle → Graphing Sine and Cosine → Graphing Tangent and Reciprocal Trigonometric Functions → Derivatives of Trigonometric Functions → Antiderivatives → Indefinite Integrals → Basic Integration Rules → Riemann Sums → Definite Integral Definition → Probability Density Functions and Continuous Distributions → Cumulative Distribution Functions → Continuous Random Variables → Probability Density Functions → Expected Value → Weak Law of Large Numbers → Probability Axioms and Rules → Conditional Probability → Conditional Distributions → Conditional Expectation → Markov Chains → Introduction to Martingales

Longest path: 97 steps · 523 total prerequisite topics

Prerequisites (2)

Leads To (7)