A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Optimal Stopping Theory

Research Depth 182 in the knowledge graph ☐ I know this ☆ Set as goal
1topic build on this
1,138prerequisites beneath it
See this on the map →
Brownian MotionIntroduction to Martingales+1 more→→Stochastic Control Basics
optimal-stopping free-boundary american-options snell-envelope

Core Idea

Optimal stopping asks: given a stochastic process X(t) and a payoff function g(X(t)), when should you stop to maximize the expected reward? The solution is characterized by the Snell envelope — the smallest supermartingale dominating the payoff process — and the optimal stopping time is the first time the process hits the boundary of the "continuation region." In continuous time, this leads to a free-boundary problem where the stopping boundary itself must be determined as part of the solution.

Explainer

Optimal stopping is the mathematical theory of deciding when to act. Given a stochastic process X(t) and a payoff g(X(t)) received upon stopping, the problem is to choose the stopping time τ that maximizes E[g(X(τ))]. The classic examples are selling an asset (stop when the price is "high enough"), exercising an option (stop when the intrinsic value justifies giving up future optionality), and the secretary problem (stop when the current candidate is likely the best). The theory draws on martingales, dynamic programming, and free-boundary problems.

In discrete time with finite horizon, the solution is given by backward induction. Define V_N(x) = g(x) (at the terminal time, you must stop). For earlier times, V_n(x) = max{g(x), E[V_{n+1}(X_{n+1}) | X_n = x]} — the maximum of stopping now versus the expected value of continuing optimally. The optimal stopping time is τ* = min{n : V_n(X_n) = g(X_n)} — the first time the value function equals the immediate payoff, meaning there is nothing to gain from waiting. The value process V_n(X_n) is the Snell envelope — the smallest supermartingale that dominates the payoff process g(X_n).

In continuous time, optimal stopping for diffusions leads to free-boundary problems. For the process dX = μ dt + σ dW with payoff g(x) and discount rate r, the value function V(x) satisfies the equation LV - rV = 0 in the continuation region C = {x : V(x) > g(x)}, where L is the generator of X, and V(x) = g(x) in the stopping region S = {x : V(x) = g(x)}. The boundary ∂C between the two regions is free — it must be determined as part of the solution. The smooth-pasting condition V'(x*) = g'(x*) at the free boundary x* is the additional equation that pins down the boundary location.

The most important financial application is American option pricing. An American put on a stock following GBM with strike K has value V(S,t) = sup_τ E_Q[e-r(τ-t)(K-S_τ)⁺]. This is a free-boundary problem: in the continuation region {S > S*(t)}, V satisfies the Black-Scholes PDE; in the stopping region {S ≤ S*(t)}, V = K - S. The exercise boundary S*(t) is a decreasing function of time (as maturity approaches, the threshold for exercising drops because there is less future optionality). Unlike European options, no closed-form formula exists for American options — they are computed by binomial trees, finite difference methods, or least-squares Monte Carlo (the Longstaff-Schwartz algorithm). The optimal stopping framework unifies these computational approaches with a rigorous mathematical foundation.

Practice Questions 4 questions

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Number Bonds to 10 → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Dividing Integers → Unit Rates → Proportions → Percent Concept → Converting Between Fractions, Decimals, and Percents → Operations with Rational Numbers → Two-Step Equations → Solving Multi-Step Equations → Equations with Variables on Both Sides → Angle Pairs: Complementary, Supplementary, and Vertical → Parallel Lines and Transversals → Corresponding Angles → Alternate Interior Angles → Triangle Angle Sum Theorem → Exterior Angle Theorem → Triangle Inequality Theorem → Similar Triangles: AA Similarity → Similar Triangles: SSS and SAS Similarity → Proportions in Similar Triangles → Right Triangle Trigonometry Introduction → Sine, Cosine, and Tangent Ratios → Trigonometric Ratios Review → Radian Measure → Converting Between Degrees and Radians → The Unit Circle → Graphing Sine and Cosine → Graphing Tangent and Reciprocal Trigonometric Functions → Derivatives of Trigonometric Functions → Antiderivatives → Indefinite Integrals → Basic Integration Rules → Riemann Sums → Definite Integral Definition → Double Integrals: Definition and Setup → Iterated Integrals and Fubini's Theorem → Double Integrals over Rectangular Regions → Double Integrals over General Regions → Applications of Double Integrals: Area, Mass, and Moments → Triple Integrals in Cartesian Coordinates → Triple Integrals in Cylindrical and Spherical Coordinates → Change of Variables and the Jacobian Determinant → Applications of Triple Integrals: Volume and Mass → Vector Fields and Their Representations → Line Integrals of Vector Fields → Work and Circulation → Line Integrals of Scalar and Vector Functions → Fundamental Theorem for Line Integrals → Conservative Vector Fields → Conservative Vector Fields and Potential Functions → Curl and Divergence of Vector Fields → Curl and Divergence → Divergence Theorem → Electric Flux and Divergence Theorem → Gauss's Law: Integral Form and Meaning → Solving Problems with Gauss's Law → Conductors in Electrostatic Equilibrium → Capacitance and Capacitors → Dielectrics → Dielectric Constant and Relative Permittivity → Electric Field Inside Dielectric Materials → Dielectric Materials and Polarization → Dielectric Susceptibility and Permittivity → Energy Density in Electric Fields → Electric Current and Current Density → Electrical Resistance and Resistivity → Ohm's Law and Circuit Elements → Electromotive Force (EMF) and Batteries → Kirchhoff's Circuit Laws: Voltage and Current → DC Circuit Network Analysis Methods → Transient Response in RC Circuits → RC Circuits → LC and RLC Circuits → AC Circuits: Fundamentals → Impedance and Reactance → AC Power and Resonance → Electromagnetic Waves → Postulates of Special Relativity → Time Dilation → Length Contraction → Lorentz Transformation → Relativistic Velocity Addition → Relativistic Momentum and Energy → Mass-Energy Equivalence and E=mc² → Photons as Particles with Energy and Momentum → Planck-Einstein Relation: Energy and Frequency → Photoelectric Effect → The Photon: Light as Quanta → Compton Scattering → Wave-Particle Duality → de Broglie Wavelength → The Schrödinger Equation → State Vectors and Wavefunctions → Quantum Superposition → Quantum Entanglement → Bell Theorem and Bell Inequalities → Postulates of Quantum Mechanics → Observables and Quantum Operators → Commutators and Commutation Relations → Quantum Angular Momentum → Quantum Mechanical Treatment of Hydrogen → Solving the Schrödinger Equation for Hydrogen Atom → Quantum Numbers → Electron Configuration → Periodic Trends → Covalent Bonding → Electronegativity and Bond Polarity → Ionic Bonding → Lewis Structures → VSEPR Theory and Molecular Geometry → Molecular Geometry and Electron Pair Geometry → Molecular Polarity and Dipole Moments → Intermolecular Forces → States of Matter and Phase Changes: Melting, Boiling, and Sublimation → Gas Laws and the Ideal Gas Equation → Gas Stoichiometry and Volume-Volume Calculations → Thermochemistry and Enthalpy → Heat Capacity and Calorimetry → Entropy and Molecular Disorder → Spontaneity and ΔG → Entropy and Gibbs Free Energy → Chemical Equilibrium → Statistical Mechanics: Ensembles and the Boltzmann Distribution → Partition Function: Definition and Properties → The Canonical Partition Function and Thermodynamic Derivation → Maxwell-Boltzmann Distribution and Classical Limit → Brownian Motion → Properties of Brownian Motion → The Itô Integral → Itô's Formula (Itô's Lemma) → Stochastic Differential Equations → Optimal Stopping Theory

Longest path: 183 steps · 1138 total prerequisite topics

Prerequisites (3)

Leads To (1)