A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Joint Distributions and Marginals (Rigorous)

Graduate Depth 82 in the knowledge graph ☐ I know this ☆ Set as goal
212topics build on this
477prerequisites beneath it
See this on the map →
Distribution Functions and Densities (Rigorous)Iterated Integrals and Fubini's Theorem→→Independence of Sigma-AlgebrasMultivariate Normal Distribution
multivariate joint-distributions measure-theory

Core Idea

For random vector X = (X₁, ..., Xₙ), the joint CDF is F(x₁,...,xₙ) = P(X₁ ≤ x₁,...,Xₙ ≤ xₙ). Marginal distributions describe individual Xᵢ. A joint pdf f satisfies P((X₁,...,Xₙ) ∈ A) = ∫ₐ f(x₁,...,xₙ) dx₁...dxₙ. The Radon-Nikodym theorem guarantees densities when distributions are absolutely continuous.

Explainer

From your prerequisite on distribution functions and densities, you know that a real-valued random variable X is characterized by its CDF F(x) = P(X ≤ x), and that when F is absolutely continuous, its derivative yields the probability density function (pdf) f with P(X ∈ A) = ∫ₐ f(x) dx. The rigorous treatment of joint distributions extends every part of this framework to random vectors — pairs, triples, and n-tuples of random variables observed simultaneously.

For a random vector (X₁, X₂), the joint CDF is F(x₁, x₂) = P(X₁ ≤ x₁ and X₂ ≤ x₂). This is a function of two variables encoding all probabilistic information about how X₁ and X₂ behave together. When the joint CDF is absolutely continuous (with respect to two-dimensional Lebesgue measure), the Radon-Nikodym theorem — the measure-theoretic version of the fundamental theorem of calculus — guarantees the existence of a joint pdf f(x₁, x₂) satisfying F(x₁, x₂) = ∫₋∞^x₁ ∫₋∞^x₂ f(u, v) dv du. Probabilities of any measurable set A are then computed using your prerequisite skill of iterated integrals: P((X₁, X₂) ∈ A) = ∬_A f(x₁, x₂) dx₁ dx₂. The Radon-Nikodym condition matters precisely because it rules out distributions with point masses, which cannot be represented by a density in the usual sense.

Marginal distributions recover the behavior of individual variables from the joint. For continuous random variables, the marginal pdf of X₁ is obtained by integrating out X₂: f₁(x₁) = ∫₋∞^∞ f(x₁, x₂) dx₂. The intuition is that you are "summing over" all possible values of the second variable, collapsing the two-dimensional distribution onto one axis. The order of integration in iterated integrals (Fubini's theorem) justifies swapping the roles of x₁ and x₂ freely when f is non-negative or integrable, which is guaranteed under the standing absolute continuity assumption. This is why rigorous control over when densities exist — via Radon-Nikodym — matters: it ensures Fubini applies.

The distinction between the joint distribution and the marginals is fundamental to everything that follows. Two random variables can have the same marginal distributions but completely different joint distributions — one might be independent, the other tightly correlated. The joint pdf carries more information than the two marginals separately. Independence is the special case where the joint pdf factors: f(x₁, x₂) = f₁(x₁) · f₂(x₂). Verifying this factorization (or its failure) using iterated integrals is the primary technical tool. The rigorous language of sigma-algebras, which this topic builds toward, allows independence to be extended beyond pairs of random variables to whole families — but the density-level intuition you develop here, integrating over one coordinate at a time, is exactly what carries over.

Practice Questions 5 questions

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Number Bonds to 10 → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Dividing Integers → Unit Rates → Proportions → Percent Concept → Converting Between Fractions, Decimals, and Percents → Operations with Rational Numbers → Two-Step Equations → Solving Multi-Step Equations → Equations with Variables on Both Sides → Angle Pairs: Complementary, Supplementary, and Vertical → Parallel Lines and Transversals → Corresponding Angles → Alternate Interior Angles → Triangle Angle Sum Theorem → Exterior Angle Theorem → Triangle Inequality Theorem → Similar Triangles: AA Similarity → Similar Triangles: SSS and SAS Similarity → Proportions in Similar Triangles → Right Triangle Trigonometry Introduction → Sine, Cosine, and Tangent Ratios → Trigonometric Ratios Review → Radian Measure → Converting Between Degrees and Radians → The Unit Circle → Graphing Sine and Cosine → Graphing Tangent and Reciprocal Trigonometric Functions → Derivatives of Trigonometric Functions → Antiderivatives → Iterated Integrals and Fubini's Theorem → Joint Distributions and Marginals (Rigorous)

Longest path: 83 steps · 477 total prerequisite topics

Prerequisites (2)

Leads To (2)