A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Bessel's Inequality and Parseval's Identity

Research Depth 86 in the knowledge graph ☐ I know this ☆ Set as goal
4topics build on this
440prerequisites beneath it
See this on the map →
Orthonormal BasesRiesz Representation Theorem (Hilbert)→→Fourier Series as Lᵖ Theory
hilbert-spaces

Core Idea

For an orthonormal sequence (eₙ), Bessel's inequality states Σ|⟨x, eₙ⟩|² ≤ ‖x‖². If the sequence is a complete orthonormal basis, Parseval's identity holds: Σ|⟨x, eₙ⟩|² = ‖x‖².

Explainer

From orthonormal bases in finite-dimensional linear algebra, you know that if {u₁, ..., uₙ} is an ONB for ℝⁿ, then any vector v can be written as v = Σ⟨v, uᵢ⟩uᵢ and the Pythagorean theorem gives ‖v‖² = Σ|⟨v, uᵢ⟩|². Now suppose you're in a Hilbert space — an infinite-dimensional inner product space that is complete — and you have a countably infinite orthonormal sequence (eₙ). The Fourier coefficients ⟨x, eₙ⟩ measure how much of the vector x lies along each basis direction, just as in the finite case.

Bessel's inequality says that the sum of squared Fourier coefficients never exceeds ‖x‖²: Σ|⟨x, eₙ⟩|² ≤ ‖x‖². The proof is elegant: form the partial sum Sₙ = Σᵢ₌₁ⁿ ⟨x, eᵢ⟩eᵢ (the projection of x onto the span of the first n basis vectors) and use the Pythagorean theorem on the orthogonal decomposition x = Sₙ + (x − Sₙ). Since ‖x − Sₙ‖² ≥ 0, we get ‖x‖² = ‖Sₙ‖² + ‖x − Sₙ‖² ≥ ‖Sₙ‖² = Σᵢ₌₁ⁿ|⟨x, eᵢ⟩|². The inequality survives as n → ∞. Bessel says the orthonormal sequence captures *at most* all of the "energy" of x.

Parseval's identity is the equality case: Σ|⟨x, eₙ⟩|² = ‖x‖². This holds precisely when the orthonormal sequence is a complete orthonormal basis — one that spans a dense subspace, meaning every vector in the Hilbert space can be approximated arbitrarily well by finite linear combinations of the basis vectors. Completeness ensures the remainder ‖x − Sₙ‖ → 0 as n → ∞, so no energy is "left over." The Riesz representation theorem (your prerequisite) guarantees that the bounded linear functionals on a Hilbert space are exactly the inner products with fixed vectors, which is the machinery that makes this convergence rigorous.

The physical and applied interpretation is that of energy conservation. In signal processing, x is a signal, the eₙ are frequency components, and ⟨x, eₙ⟩ are the amplitudes. Parseval says the total energy computed in the time domain (‖x‖²) equals the total energy computed in the frequency domain (Σ|⟨x, eₙ⟩|²). This equality is the foundation of Fourier analysis: it is what lets you work with coefficients instead of functions, confident that no information is lost in the representation.

Practice Questions 5 questions

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Number Bonds to 10 → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Introduction to Exponents → Order of Operations → Integer Order of Operations → Variable Expressions → The Distributive Property → Variables and Expressions Review → Introduction to Polynomials → Adding and Subtracting Polynomials → Multiplying Polynomials → Factorial → Permutations → Combinations → Counting Principles: Addition and Multiplication Rules → Introduction to Graph Theory → Propositional Logic Foundations → Logical Equivalences → De Morgan's Laws → Negation of Quantified Statements → Proof by Contradiction → Topological Spaces: Definition and Examples → Open Sets in Topological Spaces → Neighborhoods and Open Sets → Open Sets in Topological Spaces → Basis for a Topology → Metric Topology → Completeness in Metric Spaces → Banach Spaces → Bounded Linear Operators → The Operator Norm → Dual Spaces and Bounded Linear Functionals → Weak Convergence → Weak* Convergence → Reflexive Spaces → Riesz Representation Theorem (Hilbert) → Bessel's Inequality and Parseval's Identity

Longest path: 87 steps · 440 total prerequisite topics

Prerequisites (2)

Leads To (1)