Constrained Optimization and Lagrange Multipliers

College Depth 65 in the knowledge graph I know this Set as goal
Unlocks 465 downstream topics
lagrange-multipliers constraints optimization

Core Idea

To optimize f(x, y) subject to constraint g(x, y) = 0, solve ∇f = λ∇g at extrema. The multiplier λ indicates the rate of change of the optimum with respect to the constraint. Check boundary and critical points for absolute extrema on constrained regions.

Explainer

When you optimize a function without constraints, you look for points where the gradient is zero — flat spots where no direction of movement improves f. But many real problems impose restrictions: maximize profit given a fixed budget, minimize surface area of a container given a fixed volume, find the point on a curve closest to the origin. The Lagrange method is a systematic way to handle these constraints without eliminating variables by substitution.

The geometric insight is this: suppose you want to maximize f(x, y) subject to staying on the curve g(x, y) = 0. As you slide along the constraint curve, f changes. You have reached an optimum when moving along the constraint neither increases nor decreases f — in other words, the constraint curve is *tangent* to a level curve of f at that point. From your study of gradients, you know that ∇f is always perpendicular to the level curves of f, and similarly ∇g is always perpendicular to the constraint curve. When the two curves are tangent, they share the same tangent line and therefore have parallel normal vectors. This means ∇f and ∇g must point in the same (or opposite) direction — that is, ∇f = λ∇g for some scalar λ.

The scalar λ is the Lagrange multiplier. It is not merely an algebraic artifact; it has a concrete meaning. If you were to relax the constraint — for example, increasing the budget by one dollar — the optimal value of f would change by approximately λ. This interpretation makes λ valuable in economics (as the "shadow price" of a constraint) and in physics (as a generalized force associated with a constraint).

In practice, the method produces a system of equations: ∂f/∂x = λ(∂g/∂x), ∂f/∂y = λ(∂g/∂y), and g(x, y) = 0. For two variables and one constraint, this is three equations in three unknowns (x, y, λ). Solve for all candidates, evaluate f at each, and compare values to identify the maximum or minimum. A common error is assuming a unique solution must be a maximum — it could be a minimum, or the constraint might be unbounded, in which case no maximum exists at all.

For problems over a closed bounded region (not just a curve), you must also check *interior* critical points where ∇f = 0 and *boundary* behavior separately. The Lagrange method handles the constraint boundary, but the global optimum might occur in the interior. Always think about whether the feasible region is compact, because compactness (closed and bounded) guarantees that extrema exist and can be found by comparing all candidates.

Practice Questions 3 questions

Prerequisite Chain

Counting to 10Counting to 20Understanding ZeroThe Number ZeroCounting to FiveOne-to-One CorrespondenceCombining Small Groups Within 5Addition Within 10Addition Within 20Two-Digit Addition Without RegroupingTwo-Digit Addition with RegroupingAddition Within 100Repeated Addition as MultiplicationMultiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Two-Digit by One-Digit DivisionDivision with RemaindersRemainders and Quotients in DivisionDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueIntegers and the Number LineOpposites and Additive InversesAbsolute ValueAdding IntegersSubtracting IntegersMultiplying IntegersDividing IntegersUnit RatesProportionsPercent ConceptConverting Between Fractions, Decimals, and PercentsOperations with Rational NumbersTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesLiteral EquationsSlope-Intercept FormPoint-Slope FormWriting Linear EquationsParallel and Perpendicular Line SlopesGraphing Linear EquationsPiecewise FunctionsOne-Sided LimitsContinuity DefinitionLimit Definition of the DerivativePower RuleConstant Multiple and Sum/Difference RulesProduct RuleChain RuleChain Rule for Multivariable FunctionsChain Rule for Multivariable FunctionsImplicit Differentiation in Several VariablesLagrange MultipliersConstrained Optimization and Lagrange Multipliers

Longest path: 66 steps · 261 total prerequisite topics

Prerequisites (2)

Leads To (18)