A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Condition Number of a Problem

Graduate Depth 110 in the knowledge graph ☐ I know this ☆ Set as goal
3topics build on this
705prerequisites beneath it
See this on the map →
Numerical Stability and ConditioningMean Value Theorem→→Condition Number of a MatrixWell-Posed Problems
condition-number conditioning sensitivity

Core Idea

The condition number measures how much the solution changes relative to changes in input data. A large condition number indicates an ill-conditioned problem where small input perturbations cause large output changes. The relative condition number κ(x) = |x f'(x) / f(x)| quantifies this sensitivity for a general function f.

Explainer

From your study of numerical stability, you learned to distinguish between problems that are inherently sensitive and algorithms that introduce unnecessary error. The condition number makes the inherent sensitivity of a problem precise and quantitative. It answers: "If my input has a tiny relative error ε, how large a relative error should I expect in the output — before I've even chosen an algorithm?"

The formula κ(x) = |x f′(x) / f(x)| has a clear structure. The numerator |x f′(x)| captures how fast the output changes (via the derivative, connecting to the Mean Value Theorem you know), scaled by the size of the input x. The denominator |f(x)| normalizes by the output size. The result is dimensionless: a condition number of 100 means a relative input error of 0.01% can produce a relative output error of up to 1%. You can think of κ as an amplification factor for relative errors.

Concrete examples sharpen the intuition. Consider f(x) = √x near x = 1. Here κ(1) = |1 · (1/2) / 1| = 0.5 — well-conditioned; relative errors shrink by half. Now consider f(x) = ln(x) near x ≈ 1. Here f′(x) = 1/x, so κ(x) = |x · (1/x) / ln(x)| = 1/|ln(x)|. As x → 1, ln(x) → 0, so κ → ∞. Taking the logarithm of a number close to 1 is ill-conditioned: tiny relative errors in x produce enormous relative errors in ln(x). This is a property of the mathematical problem, not the algorithm.

A critical conceptual move: conditioning is a problem property, stability is an algorithm property. An ill-conditioned problem will give inaccurate answers no matter how careful you are — the underlying mathematics is sensitive, and floating-point inputs always carry small errors. A well-conditioned problem, however, can still be ruined by an unstable algorithm. The condition number sets the ceiling on achievable accuracy; stable algorithms approach that ceiling. When numerical results look wrong, diagnosing which of these two issues you have — is the problem ill-conditioned, or is the algorithm unstable? — determines whether better arithmetic or a better algorithm is the solution.

Practice Questions 5 questions

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Number Bonds to 10 → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Dividing Integers → Unit Rates → Proportions → Percent Concept → Converting Between Fractions, Decimals, and Percents → Operations with Rational Numbers → Two-Step Equations → Solving Multi-Step Equations → Equations with Variables on Both Sides → Angle Pairs: Complementary, Supplementary, and Vertical → Parallel Lines and Transversals → Corresponding Angles → Alternate Interior Angles → Triangle Angle Sum Theorem → Exterior Angle Theorem → Triangle Inequality Theorem → Similar Triangles: AA Similarity → Similar Triangles: SSS and SAS Similarity → Proportions in Similar Triangles → Right Triangle Trigonometry Introduction → Sine, Cosine, and Tangent Ratios → Trigonometric Ratios Review → Radian Measure → Converting Between Degrees and Radians → The Unit Circle → Graphing Sine and Cosine → Graphing Tangent and Reciprocal Trigonometric Functions → Derivatives of Trigonometric Functions → Antiderivatives → Indefinite Integrals → Basic Integration Rules → Riemann Sums → Definite Integral Definition → Double Integrals: Definition and Setup → Iterated Integrals and Fubini's Theorem → Double Integrals over Rectangular Regions → Double Integrals over General Regions → Applications of Double Integrals: Area, Mass, and Moments → Center of Mass → Conservation of Linear Momentum → Elastic Collisions → Inelastic Collisions → Coefficient of Restitution → Collision Analysis and Real-World Applications → Two-Body Collisions in the Center-of-Mass Frame → Reduced Mass and Two-Body Problems → Kinematics in Two Dimensions → Projectile Motion → Circular Motion: Kinematics → Simple Harmonic Motion → Introduction to Differential Equations → Euler's Method for Numerical Solutions → Euler's Method for ODEs (Error Analysis) → Runge-Kutta Methods → Multistep Methods: Adams-Bashforth and Adams-Moulton → Stiff Differential Equations and Stability Regions → Stability Regions and A-Stability → Numerical Stability and Conditioning → Condition Number of a Problem

Longest path: 111 steps · 705 total prerequisite topics

Prerequisites (2)

Leads To (2)