Marginal Distributions

College Depth 75 in the knowledge graph I know this Set as goal
Unlocks 6 downstream topics
marginal-distributions multivariate probability

Core Idea

The marginal distribution of one variable is obtained by summing/integrating the joint distribution over the other variables. For bivariate: P(X=x) = Σ_y P(X=x, Y=y). Marginal distributions describe individual variables while ignoring others.

How It's Best Learned

Start with joint probability tables and compute marginals by summing rows or columns. For continuous distributions, practice computing marginals via integration. Recognize marginals in frequency tables.

Explainer

A joint distribution captures the full probabilistic relationship between two (or more) random variables at once — it tells you how likely every combination of values is. But often you only care about one variable at a time. The marginal distribution is how you recover the single-variable picture from the joint one by systematically "collapsing" the other variable out of the picture.

The mechanism is straightforward and follows directly from the total probability law you already know. For discrete variables, imagine a joint probability table where rows represent values of X and columns represent values of Y. The cell at row x, column y holds P(X=x, Y=y). To get the marginal P(X=x) — the probability that X equals x, regardless of what Y does — you sum across the entire row: P(X=x) = Σ_y P(X=x, Y=y). You're averaging over all possible Y values, weighted by their probabilities. Literally: add up each column entry in row x. The resulting row-sums form the marginal distribution of X; the column-sums form the marginal of Y. This is where the term "marginal" comes from — historically, these sums were written in the margins of the table.

For continuous joint distributions f(x, y), the logic is identical but summation becomes integration: f_X(x) = ∫ f(x, y) dy. You fix x and integrate out y over its entire range, leaving a function of x alone. The resulting f_X is a valid probability density — it integrates to 1 — and it describes X's behavior irrespective of Y. The key insight is that marginalization discards information about the relationship between variables without discarding information about each variable individually. The joint distribution contains everything; the marginals contain only each variable's behavior in isolation.

One critical implication: you cannot generally recover the joint distribution from the marginals alone. Two pairs of variables can share identical marginals yet have completely different joint distributions — one pair might be independent, another strongly correlated. Independence is the special case where the joint factors into the product of the marginals: P(X=x, Y=y) = P(X=x) · P(Y=y) for all x, y. When that factorization fails, the variables are dependent and the marginals fail to capture the relationship. This asymmetry — joint implies marginals, but marginals don't imply joint — is one of the foundational lessons of multivariate probability.

Practice Questions 5 questions

Prerequisite Chain

Counting to 10Counting to 20Understanding ZeroThe Number ZeroCounting to FiveOne-to-One CorrespondenceCombining Small Groups Within 5Addition Within 10Addition Within 20Two-Digit Addition Without RegroupingTwo-Digit Addition with RegroupingAddition Within 100Repeated Addition as MultiplicationMultiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Two-Digit by One-Digit DivisionDivision with RemaindersRemainders and Quotients in DivisionDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueReading and Writing DecimalsComparing and Ordering DecimalsAdding and Subtracting DecimalsMultiplying DecimalsDividing DecimalsDividing FractionsMixed Number ArithmeticOrder of OperationsInteger Order of OperationsVariable ExpressionsCombining Like TermsOne-Step EquationsTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesAngle Pairs: Complementary, Supplementary, and VerticalParallel Lines and TransversalsCorresponding AnglesAlternate Interior AnglesTriangle Angle Sum TheoremExterior Angle TheoremTriangle Inequality TheoremSimilar Triangles: AA SimilaritySimilar Triangles: SSS and SAS SimilarityProportions in Similar TrianglesRight Triangle Trigonometry IntroductionTrigonometric Ratios ReviewRadian MeasureConverting Between Degrees and RadiansThe Unit CircleGraphing Sine and CosineGraphing Tangent and Reciprocal Trigonometric FunctionsDerivatives of Trigonometric FunctionsAntiderivativesIndefinite IntegralsBasic Integration RulesRiemann SumsDefinite Integral DefinitionProbability Density Functions and Continuous DistributionsCumulative Distribution FunctionsContinuous Random VariablesProbability Density FunctionsJoint Probability DistributionsMarginal Distributions

Longest path: 76 steps · 313 total prerequisite topics

Prerequisites (1)

Leads To (1)