Optimal Stopping Theory

Research Depth 111 in the knowledge graph I know this Set as goal
Unlocks 1 downstream topic
optimal-stopping free-boundary american-options snell-envelope

Core Idea

Optimal stopping asks: given a stochastic process X(t) and a payoff function g(X(t)), when should you stop to maximize the expected reward? The solution is characterized by the Snell envelope — the smallest supermartingale dominating the payoff process — and the optimal stopping time is the first time the process hits the boundary of the "continuation region." In continuous time, this leads to a free-boundary problem where the stopping boundary itself must be determined as part of the solution.

Explainer

Optimal stopping is the mathematical theory of deciding when to act. Given a stochastic process X(t) and a payoff g(X(t)) received upon stopping, the problem is to choose the stopping time τ that maximizes E[g(X(τ))]. The classic examples are selling an asset (stop when the price is "high enough"), exercising an option (stop when the intrinsic value justifies giving up future optionality), and the secretary problem (stop when the current candidate is likely the best). The theory draws on martingales, dynamic programming, and free-boundary problems.

In discrete time with finite horizon, the solution is given by backward induction. Define V_N(x) = g(x) (at the terminal time, you must stop). For earlier times, V_n(x) = max{g(x), E[V_{n+1}(X_{n+1}) | X_n = x]} — the maximum of stopping now versus the expected value of continuing optimally. The optimal stopping time is τ* = min{n : V_n(X_n) = g(X_n)} — the first time the value function equals the immediate payoff, meaning there is nothing to gain from waiting. The value process V_n(X_n) is the Snell envelope — the smallest supermartingale that dominates the payoff process g(X_n).

In continuous time, optimal stopping for diffusions leads to free-boundary problems. For the process dX = μ dt + σ dW with payoff g(x) and discount rate r, the value function V(x) satisfies the equation LV - rV = 0 in the continuation region C = {x : V(x) > g(x)}, where L is the generator of X, and V(x) = g(x) in the stopping region S = {x : V(x) = g(x)}. The boundary ∂C between the two regions is free — it must be determined as part of the solution. The smooth-pasting condition V'(x*) = g'(x*) at the free boundary x* is the additional equation that pins down the boundary location.

The most important financial application is American option pricing. An American put on a stock following GBM with strike K has value V(S,t) = sup_τ E_Q[e^{-r(τ-t)}(K-S_τ)⁺]. This is a free-boundary problem: in the continuation region {S > S*(t)}, V satisfies the Black-Scholes PDE; in the stopping region {S ≤ S*(t)}, V = K - S. The exercise boundary S*(t) is a decreasing function of time (as maturity approaches, the threshold for exercising drops because there is less future optionality). Unlike European options, no closed-form formula exists for American options — they are computed by binomial trees, finite difference methods, or least-squares Monte Carlo (the Longstaff-Schwartz algorithm). The optimal stopping framework unifies these computational approaches with a rigorous mathematical foundation.

Practice Questions 4 questions

Prerequisite Chain

Counting to 10Counting to 20Understanding ZeroThe Number ZeroCounting to FiveOne-to-One CorrespondenceCombining Small Groups Within 5Addition Within 10Addition Within 20Two-Digit Addition Without RegroupingTwo-Digit Addition with RegroupingAddition Within 100Repeated Addition as MultiplicationMultiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Two-Digit by One-Digit DivisionDivision with RemaindersRemainders and Quotients in DivisionDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueReading and Writing DecimalsComparing and Ordering DecimalsAdding and Subtracting DecimalsMultiplying DecimalsDividing DecimalsDividing FractionsMixed Number ArithmeticOrder of OperationsInteger Order of OperationsVariable ExpressionsCombining Like TermsOne-Step EquationsTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesAngle Pairs: Complementary, Supplementary, and VerticalParallel Lines and TransversalsCorresponding AnglesAlternate Interior AnglesTriangle Angle Sum TheoremExterior Angle TheoremTriangle Inequality TheoremSimilar Triangles: AA SimilaritySimilar Triangles: SSS and SAS SimilarityProportions in Similar TrianglesRight Triangle Trigonometry IntroductionTrigonometric Ratios ReviewRadian MeasureConverting Between Degrees and RadiansThe Unit CircleGraphing Sine and CosineGraphing Tangent and Reciprocal Trigonometric FunctionsDerivatives of Trigonometric FunctionsAntiderivativesIterated Integrals and Fubini's TheoremDouble Integrals in Cartesian CoordinatesDouble Integrals over Rectangular RegionsDouble Integrals in Polar CoordinatesDouble Integrals: Definition and SetupIterated Integrals and Fubini's TheoremDouble Integrals over Rectangular RegionsDouble Integrals over General RegionsApplications of Double Integrals: Area, Mass, and MomentsCenter of MassConservation of Linear MomentumElastic CollisionsInelastic CollisionsCoefficient of RestitutionCollision Analysis and Real-World ApplicationsTwo-Body Collisions in the Center-of-Mass FrameReduced Mass and Two-Body ProblemsKinematics in Two DimensionsProjectile MotionCircular Motion: KinematicsRotational KinematicsTorqueMoment of InertiaRotational Kinetic EnergyThe Work-Energy TheoremConservation of Mechanical EnergyFirst Law of ThermodynamicsThermodynamic Processes and the PV DiagramIsobaric and Isochoric ProcessesHeat EnginesThermal Efficiency of Heat EnginesRefrigerators and Heat PumpsSecond Law of ThermodynamicsEntropyMicrostates and MacrostatesEnsemble Theory FundamentalsCanonical Ensemble (NVT)Partition Function: Definition and PropertiesThe Canonical Partition Function and Thermodynamic DerivationMaxwell-Boltzmann Distribution and Classical LimitBrownian MotionProperties of Brownian MotionThe Itô IntegralItô's Formula (Itô's Lemma)Stochastic Differential EquationsOptimal Stopping Theory

Longest path: 112 steps · 529 total prerequisite topics

Prerequisites (3)

Leads To (1)