A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

The Operator Norm

Research Depth 80 in the knowledge graph ☐ I know this ☆ Set as goal
51topics build on this
384prerequisites beneath it
See this on the map →
Bounded Linear Operators→→Dual Spaces and Bounded Linear FunctionalsLinear Functionals and Dual Spaces
functional-analysis operators

Core Idea

For a bounded linear operator T: X → Y, the operator norm is ‖T‖ = sup{‖T(x)‖_Y : ‖x‖_X ≤ 1}. The space ℒ(X,Y) of bounded operators is itself a normed space (Banach if Y is Banach).

Explainer

From bounded linear operators, you know that T: X → Y is bounded if there exists a constant C such that ‖T(x)‖_Y ≤ C‖x‖_X for every x ∈ X. Many constants C work — the operator norm ‖T‖ is the smallest one that does. Formally, ‖T‖ = sup{‖T(x)‖_Y : ‖x‖_X ≤ 1}, which is the supremum of ‖T(x)‖ over the unit ball. Equivalently, ‖T‖ = sup{‖T(x)‖ / ‖x‖ : x ≠ 0}, the worst-case stretching factor. The operator norm answers: "by at most how much can T amplify a vector?"

In finite dimensions — when X = Rⁿ and Y = Rᵐ with their standard norms — every linear map is a matrix multiplication and every matrix is bounded. The operator norm of a matrix A (with respect to Euclidean norms) equals its largest singular value, which you might have seen as the square root of the largest eigenvalue of AᵀA. The unit ball in Rⁿ is a round sphere; T maps it to an ellipsoid in Rᵐ; the operator norm is the length of the longest axis of that ellipsoid. This geometric picture carries over to infinite dimensions, though "ellipsoid" becomes an abstract image.

The deeper significance of the operator norm is that it makes ℒ(X, Y) — the set of all bounded linear operators from X to Y — into a normed space. The norm axioms all check out: ‖T‖ = 0 if and only if T is the zero operator, ‖αT‖ = |α|‖T‖, and the triangle inequality ‖S + T‖ ≤ ‖S‖ + ‖T‖ holds. This means you can add operators, scale them, and take limits within ℒ(X, Y) using the operator norm as the notion of convergence. When Y is a Banach space (complete with respect to its norm), ℒ(X, Y) is also Banach — Cauchy sequences of operators converge to operators.

The operator norm also satisfies the submultiplicativity property ‖ST‖ ≤ ‖S‖‖T‖ whenever the composition makes sense. This is the operator analog of the scalar inequality |ab| = |a||b|, but it is an *inequality* rather than equality because composing two operators may not stretch as much as each would alone. Submultiplicativity is what makes the operator norm a Banach algebra norm on ℒ(X, X), the square case. This structure underpins the theory of functional calculus and the spectral theory of operators you will encounter next — the norm controls how analytic functions of operators (like eᵀ or (T − λI)⁻¹) behave.

Practice Questions 5 questions

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Number Bonds to 10 → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Introduction to Exponents → Order of Operations → Integer Order of Operations → Variable Expressions → The Distributive Property → Variables and Expressions Review → Introduction to Polynomials → Adding and Subtracting Polynomials → Multiplying Polynomials → Factorial → Permutations → Combinations → Counting Principles: Addition and Multiplication Rules → Introduction to Graph Theory → Propositional Logic Foundations → Logical Equivalences → De Morgan's Laws → Negation of Quantified Statements → Proof by Contradiction → Topological Spaces: Definition and Examples → Open Sets in Topological Spaces → Neighborhoods and Open Sets → Open Sets in Topological Spaces → Basis for a Topology → Metric Topology → Completeness in Metric Spaces → Banach Spaces → Bounded Linear Operators → The Operator Norm

Longest path: 81 steps · 384 total prerequisite topics

Prerequisites (1)

Leads To (2)