A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Optimal Stopping Theory

Research Depth 182 in the knowledge graph I know this Set as goal
1topic build on this
1,138prerequisites beneath it
See this on the map →
Brownian MotionIntroduction to Martingales+1 moreStochastic Control Basics
optimal-stopping free-boundary american-options snell-envelope

Core Idea

Optimal stopping asks: given a stochastic process X(t) and a payoff function g(X(t)), when should you stop to maximize the expected reward? The solution is characterized by the Snell envelope — the smallest supermartingale dominating the payoff process — and the optimal stopping time is the first time the process hits the boundary of the "continuation region." In continuous time, this leads to a free-boundary problem where the stopping boundary itself must be determined as part of the solution.

Explainer

Optimal stopping is the mathematical theory of deciding when to act. Given a stochastic process X(t) and a payoff g(X(t)) received upon stopping, the problem is to choose the stopping time τ that maximizes E[g(X(τ))]. The classic examples are selling an asset (stop when the price is "high enough"), exercising an option (stop when the intrinsic value justifies giving up future optionality), and the secretary problem (stop when the current candidate is likely the best). The theory draws on martingales, dynamic programming, and free-boundary problems.

In discrete time with finite horizon, the solution is given by backward induction. Define V_N(x) = g(x) (at the terminal time, you must stop). For earlier times, V_n(x) = max{g(x), E[V_{n+1}(X_{n+1}) | X_n = x]} — the maximum of stopping now versus the expected value of continuing optimally. The optimal stopping time is τ* = min{n : V_n(X_n) = g(X_n)} — the first time the value function equals the immediate payoff, meaning there is nothing to gain from waiting. The value process V_n(X_n) is the Snell envelope — the smallest supermartingale that dominates the payoff process g(X_n).

In continuous time, optimal stopping for diffusions leads to free-boundary problems. For the process dX = μ dt + σ dW with payoff g(x) and discount rate r, the value function V(x) satisfies the equation LV - rV = 0 in the continuation region C = {x : V(x) > g(x)}, where L is the generator of X, and V(x) = g(x) in the stopping region S = {x : V(x) = g(x)}. The boundary ∂C between the two regions is free — it must be determined as part of the solution. The smooth-pasting condition V'(x*) = g'(x*) at the free boundary x* is the additional equation that pins down the boundary location.

The most important financial application is American option pricing. An American put on a stock following GBM with strike K has value V(S,t) = sup_τ E_Q[e-r(τ-t)(K-S_τ)⁺]. This is a free-boundary problem: in the continuation region {S > S*(t)}, V satisfies the Black-Scholes PDE; in the stopping region {S ≤ S*(t)}, V = K - S. The exercise boundary S*(t) is a decreasing function of time (as maturity approaches, the threshold for exercising drops because there is less future optionality). Unlike European options, no closed-form formula exists for American options — they are computed by binomial trees, finite difference methods, or least-squares Monte Carlo (the Longstaff-Schwartz algorithm). The optimal stopping framework unifies these computational approaches with a rigorous mathematical foundation.

Practice Questions 4 questions

Prerequisite Chain

Understanding ZeroThe Number ZeroCounting to FiveCounting to 10Counting to 20Counting a Set of Objects Up to 20Cardinality: The Last Number CountedMatching Numerals to QuantitiesSubitizing Small QuantitiesAddition Within 10Number Bonds to 10Addition Within 20Doubles and Near DoublesDoubles Facts Within 10Near Doubles Facts Within 20Mental Math Strategies for AdditionMental Math: Adding and Subtracting TensAddition Within 100Repeated Addition as MultiplicationMultiplication as Equal GroupsMultiplication: ArraysBasic Multiplication Facts (0s, 1s, 2s, 5s, 10s)Multiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Multiplication and Division Fact FamiliesRelationship Between Multiplication and DivisionDivision Facts as Inverse of MultiplicationRemainders and Quotients in DivisionDivision Word ProblemsMulti-Step Word ProblemsSolving Multi-Step Word ProblemsMultiplication Word ProblemsDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueIntegers and the Number LineComparing and Ordering IntegersAbsolute ValueAdding IntegersSubtracting IntegersMultiplying IntegersDividing IntegersUnit RatesProportionsPercent ConceptConverting Between Fractions, Decimals, and PercentsOperations with Rational NumbersTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesAngle Pairs: Complementary, Supplementary, and VerticalParallel Lines and TransversalsCorresponding AnglesAlternate Interior AnglesTriangle Angle Sum TheoremExterior Angle TheoremTriangle Inequality TheoremSimilar Triangles: AA SimilaritySimilar Triangles: SSS and SAS SimilarityProportions in Similar TrianglesRight Triangle Trigonometry IntroductionSine, Cosine, and Tangent RatiosTrigonometric Ratios ReviewRadian MeasureConverting Between Degrees and RadiansThe Unit CircleGraphing Sine and CosineGraphing Tangent and Reciprocal Trigonometric FunctionsDerivatives of Trigonometric FunctionsAntiderivativesIndefinite IntegralsBasic Integration RulesRiemann SumsDefinite Integral DefinitionDouble Integrals: Definition and SetupIterated Integrals and Fubini's TheoremDouble Integrals over Rectangular RegionsDouble Integrals over General RegionsApplications of Double Integrals: Area, Mass, and MomentsTriple Integrals in Cartesian CoordinatesTriple Integrals in Cylindrical and Spherical CoordinatesChange of Variables and the Jacobian DeterminantApplications of Triple Integrals: Volume and MassVector Fields and Their RepresentationsLine Integrals of Vector FieldsWork and CirculationLine Integrals of Scalar and Vector FunctionsFundamental Theorem for Line IntegralsConservative Vector FieldsConservative Vector Fields and Potential FunctionsCurl and Divergence of Vector FieldsCurl and DivergenceDivergence TheoremElectric Flux and Divergence TheoremGauss's Law: Integral Form and MeaningSolving Problems with Gauss's LawConductors in Electrostatic EquilibriumCapacitance and CapacitorsDielectricsDielectric Constant and Relative PermittivityElectric Field Inside Dielectric MaterialsDielectric Materials and PolarizationDielectric Susceptibility and PermittivityEnergy Density in Electric FieldsElectric Current and Current DensityElectrical Resistance and ResistivityOhm's Law and Circuit ElementsElectromotive Force (EMF) and BatteriesKirchhoff's Circuit Laws: Voltage and CurrentDC Circuit Network Analysis MethodsTransient Response in RC CircuitsRC CircuitsLC and RLC CircuitsAC Circuits: FundamentalsImpedance and ReactanceAC Power and ResonanceElectromagnetic WavesPostulates of Special RelativityTime DilationLength ContractionLorentz TransformationRelativistic Velocity AdditionRelativistic Momentum and EnergyMass-Energy Equivalence and E=mc²Photons as Particles with Energy and MomentumPlanck-Einstein Relation: Energy and FrequencyPhotoelectric EffectThe Photon: Light as QuantaCompton ScatteringWave-Particle Dualityde Broglie WavelengthThe Schrödinger EquationState Vectors and WavefunctionsQuantum SuperpositionQuantum EntanglementBell Theorem and Bell InequalitiesPostulates of Quantum MechanicsObservables and Quantum OperatorsCommutators and Commutation RelationsQuantum Angular MomentumQuantum Mechanical Treatment of HydrogenSolving the Schrödinger Equation for Hydrogen AtomQuantum NumbersElectron ConfigurationPeriodic TrendsCovalent BondingElectronegativity and Bond PolarityIonic BondingLewis StructuresVSEPR Theory and Molecular GeometryMolecular Geometry and Electron Pair GeometryMolecular Polarity and Dipole MomentsIntermolecular ForcesStates of Matter and Phase Changes: Melting, Boiling, and SublimationGas Laws and the Ideal Gas EquationGas Stoichiometry and Volume-Volume CalculationsThermochemistry and EnthalpyHeat Capacity and CalorimetryEntropy and Molecular DisorderSpontaneity and ΔGEntropy and Gibbs Free EnergyChemical EquilibriumStatistical Mechanics: Ensembles and the Boltzmann DistributionPartition Function: Definition and PropertiesThe Canonical Partition Function and Thermodynamic DerivationMaxwell-Boltzmann Distribution and Classical LimitBrownian MotionProperties of Brownian MotionThe Itô IntegralItô's Formula (Itô's Lemma)Stochastic Differential EquationsOptimal Stopping Theory

Longest path: 183 steps · 1138 total prerequisite topics

Prerequisites (3)

Leads To (1)