A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Condition Number of a Problem

Graduate Depth 110 in the knowledge graph I know this Set as goal
3topics build on this
705prerequisites beneath it
See this on the map →
Numerical Stability and ConditioningMean Value TheoremCondition Number of a MatrixWell-Posed Problems
condition-number conditioning sensitivity

Core Idea

The condition number measures how much the solution changes relative to changes in input data. A large condition number indicates an ill-conditioned problem where small input perturbations cause large output changes. The relative condition number κ(x) = |x f'(x) / f(x)| quantifies this sensitivity for a general function f.

Explainer

From your study of numerical stability, you learned to distinguish between problems that are inherently sensitive and algorithms that introduce unnecessary error. The condition number makes the inherent sensitivity of a problem precise and quantitative. It answers: "If my input has a tiny relative error ε, how large a relative error should I expect in the output — before I've even chosen an algorithm?"

The formula κ(x) = |x f′(x) / f(x)| has a clear structure. The numerator |x f′(x)| captures how fast the output changes (via the derivative, connecting to the Mean Value Theorem you know), scaled by the size of the input x. The denominator |f(x)| normalizes by the output size. The result is dimensionless: a condition number of 100 means a relative input error of 0.01% can produce a relative output error of up to 1%. You can think of κ as an amplification factor for relative errors.

Concrete examples sharpen the intuition. Consider f(x) = √x near x = 1. Here κ(1) = |1 · (1/2) / 1| = 0.5 — well-conditioned; relative errors shrink by half. Now consider f(x) = ln(x) near x ≈ 1. Here f′(x) = 1/x, so κ(x) = |x · (1/x) / ln(x)| = 1/|ln(x)|. As x → 1, ln(x) → 0, so κ → ∞. Taking the logarithm of a number close to 1 is ill-conditioned: tiny relative errors in x produce enormous relative errors in ln(x). This is a property of the mathematical problem, not the algorithm.

A critical conceptual move: conditioning is a problem property, stability is an algorithm property. An ill-conditioned problem will give inaccurate answers no matter how careful you are — the underlying mathematics is sensitive, and floating-point inputs always carry small errors. A well-conditioned problem, however, can still be ruined by an unstable algorithm. The condition number sets the ceiling on achievable accuracy; stable algorithms approach that ceiling. When numerical results look wrong, diagnosing which of these two issues you have — is the problem ill-conditioned, or is the algorithm unstable? — determines whether better arithmetic or a better algorithm is the solution.

Practice Questions 5 questions

Prerequisite Chain

Understanding ZeroThe Number ZeroCounting to FiveCounting to 10Counting to 20Counting a Set of Objects Up to 20Cardinality: The Last Number CountedMatching Numerals to QuantitiesSubitizing Small QuantitiesAddition Within 10Number Bonds to 10Addition Within 20Doubles and Near DoublesDoubles Facts Within 10Near Doubles Facts Within 20Mental Math Strategies for AdditionMental Math: Adding and Subtracting TensAddition Within 100Repeated Addition as MultiplicationMultiplication as Equal GroupsMultiplication: ArraysBasic Multiplication Facts (0s, 1s, 2s, 5s, 10s)Multiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Multiplication and Division Fact FamiliesRelationship Between Multiplication and DivisionDivision Facts as Inverse of MultiplicationRemainders and Quotients in DivisionDivision Word ProblemsMulti-Step Word ProblemsSolving Multi-Step Word ProblemsMultiplication Word ProblemsDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueIntegers and the Number LineComparing and Ordering IntegersAbsolute ValueAdding IntegersSubtracting IntegersMultiplying IntegersDividing IntegersUnit RatesProportionsPercent ConceptConverting Between Fractions, Decimals, and PercentsOperations with Rational NumbersTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesAngle Pairs: Complementary, Supplementary, and VerticalParallel Lines and TransversalsCorresponding AnglesAlternate Interior AnglesTriangle Angle Sum TheoremExterior Angle TheoremTriangle Inequality TheoremSimilar Triangles: AA SimilaritySimilar Triangles: SSS and SAS SimilarityProportions in Similar TrianglesRight Triangle Trigonometry IntroductionSine, Cosine, and Tangent RatiosTrigonometric Ratios ReviewRadian MeasureConverting Between Degrees and RadiansThe Unit CircleGraphing Sine and CosineGraphing Tangent and Reciprocal Trigonometric FunctionsDerivatives of Trigonometric FunctionsAntiderivativesIndefinite IntegralsBasic Integration RulesRiemann SumsDefinite Integral DefinitionDouble Integrals: Definition and SetupIterated Integrals and Fubini's TheoremDouble Integrals over Rectangular RegionsDouble Integrals over General RegionsApplications of Double Integrals: Area, Mass, and MomentsCenter of MassConservation of Linear MomentumElastic CollisionsInelastic CollisionsCoefficient of RestitutionCollision Analysis and Real-World ApplicationsTwo-Body Collisions in the Center-of-Mass FrameReduced Mass and Two-Body ProblemsKinematics in Two DimensionsProjectile MotionCircular Motion: KinematicsSimple Harmonic MotionIntroduction to Differential EquationsEuler's Method for Numerical SolutionsEuler's Method for ODEs (Error Analysis)Runge-Kutta MethodsMultistep Methods: Adams-Bashforth and Adams-MoultonStiff Differential Equations and Stability RegionsStability Regions and A-StabilityNumerical Stability and ConditioningCondition Number of a Problem

Longest path: 111 steps · 705 total prerequisite topics

Prerequisites (2)

Leads To (2)