A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Bessel's Inequality and Parseval's Identity

Research Depth 86 in the knowledge graph I know this Set as goal
4topics build on this
440prerequisites beneath it
See this on the map →
Orthonormal BasesRiesz Representation Theorem (Hilbert)Fourier Series as Lᵖ Theory
hilbert-spaces

Core Idea

For an orthonormal sequence (eₙ), Bessel's inequality states Σ|⟨x, eₙ⟩|² ≤ ‖x‖². If the sequence is a complete orthonormal basis, Parseval's identity holds: Σ|⟨x, eₙ⟩|² = ‖x‖².

Explainer

From orthonormal bases in finite-dimensional linear algebra, you know that if {u₁, ..., uₙ} is an ONB for ℝⁿ, then any vector v can be written as v = Σ⟨v, uᵢ⟩uᵢ and the Pythagorean theorem gives ‖v‖² = Σ|⟨v, uᵢ⟩|². Now suppose you're in a Hilbert space — an infinite-dimensional inner product space that is complete — and you have a countably infinite orthonormal sequence (eₙ). The Fourier coefficients ⟨x, eₙ⟩ measure how much of the vector x lies along each basis direction, just as in the finite case.

Bessel's inequality says that the sum of squared Fourier coefficients never exceeds ‖x‖²: Σ|⟨x, eₙ⟩|² ≤ ‖x‖². The proof is elegant: form the partial sum Sₙ = Σᵢ₌₁ⁿ ⟨x, eᵢ⟩eᵢ (the projection of x onto the span of the first n basis vectors) and use the Pythagorean theorem on the orthogonal decomposition x = Sₙ + (x − Sₙ). Since ‖x − Sₙ‖² ≥ 0, we get ‖x‖² = ‖Sₙ‖² + ‖x − Sₙ‖² ≥ ‖Sₙ‖² = Σᵢ₌₁ⁿ|⟨x, eᵢ⟩|². The inequality survives as n → ∞. Bessel says the orthonormal sequence captures *at most* all of the "energy" of x.

Parseval's identity is the equality case: Σ|⟨x, eₙ⟩|² = ‖x‖². This holds precisely when the orthonormal sequence is a complete orthonormal basis — one that spans a dense subspace, meaning every vector in the Hilbert space can be approximated arbitrarily well by finite linear combinations of the basis vectors. Completeness ensures the remainder ‖x − Sₙ‖ → 0 as n → ∞, so no energy is "left over." The Riesz representation theorem (your prerequisite) guarantees that the bounded linear functionals on a Hilbert space are exactly the inner products with fixed vectors, which is the machinery that makes this convergence rigorous.

The physical and applied interpretation is that of energy conservation. In signal processing, x is a signal, the eₙ are frequency components, and ⟨x, eₙ⟩ are the amplitudes. Parseval says the total energy computed in the time domain (‖x‖²) equals the total energy computed in the frequency domain (Σ|⟨x, eₙ⟩|²). This equality is the foundation of Fourier analysis: it is what lets you work with coefficients instead of functions, confident that no information is lost in the representation.

Practice Questions 5 questions

Prerequisite Chain

Understanding ZeroThe Number ZeroCounting to FiveCounting to 10Counting to 20Counting a Set of Objects Up to 20Cardinality: The Last Number CountedMatching Numerals to QuantitiesSubitizing Small QuantitiesAddition Within 10Number Bonds to 10Addition Within 20Doubles and Near DoublesDoubles Facts Within 10Near Doubles Facts Within 20Mental Math Strategies for AdditionMental Math: Adding and Subtracting TensAddition Within 100Repeated Addition as MultiplicationMultiplication as Equal GroupsMultiplication: ArraysBasic Multiplication Facts (0s, 1s, 2s, 5s, 10s)Multiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Multiplication and Division Fact FamiliesRelationship Between Multiplication and DivisionDivision Facts as Inverse of MultiplicationRemainders and Quotients in DivisionDivision Word ProblemsMulti-Step Word ProblemsSolving Multi-Step Word ProblemsMultiplication Word ProblemsDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueIntegers and the Number LineComparing and Ordering IntegersAbsolute ValueAdding IntegersSubtracting IntegersMultiplying IntegersIntroduction to ExponentsOrder of OperationsInteger Order of OperationsVariable ExpressionsThe Distributive PropertyVariables and Expressions ReviewIntroduction to PolynomialsAdding and Subtracting PolynomialsMultiplying PolynomialsFactorialPermutationsCombinationsCounting Principles: Addition and Multiplication RulesIntroduction to Graph TheoryPropositional Logic FoundationsLogical EquivalencesDe Morgan's LawsNegation of Quantified StatementsProof by ContradictionTopological Spaces: Definition and ExamplesOpen Sets in Topological SpacesNeighborhoods and Open SetsOpen Sets in Topological SpacesBasis for a TopologyMetric TopologyCompleteness in Metric SpacesBanach SpacesBounded Linear OperatorsThe Operator NormDual Spaces and Bounded Linear FunctionalsWeak ConvergenceWeak* ConvergenceReflexive SpacesRiesz Representation Theorem (Hilbert)Bessel's Inequality and Parseval's Identity

Longest path: 87 steps · 440 total prerequisite topics

Prerequisites (2)

Leads To (1)