Variance and Standard Deviation of Random Variables

College Depth 63 in the knowledge graph I know this Set as goal
Unlocks 1092 downstream topics
variance standard-deviation random-variable spread

Core Idea

The variance of a random variable X is Var(X) = E[(X − μ)²] = E(X²) − [E(X)]², measuring expected squared deviation from the mean. The standard deviation σ = √Var(X) restores original units. Key rules: Var(aX + b) = a²Var(X) (adding a constant doesn't change spread; scaling multiplies variance by the square of the scale factor). For independent variables, Var(X + Y) = Var(X) + Var(Y) — variances add for independent random variables, but standard deviations do not.

How It's Best Learned

Use the shortcut formula E(X²) − μ² in practice, but derive Var(X) = E[(X − μ)²] conceptually first. Emphasize the independence requirement for adding variances — this is a common source of errors.

Common Misconceptions

Explainer

You learned that the expected value E(X) gives the long-run average of a random variable. But two very different distributions can share the same mean — knowing the average tells you nothing about how spread out the outcomes are. Variance measures that spread: it asks, on average, how far from the mean does X land?

The formula Var(X) = E[(X − μ)²] says: for each possible outcome of X, compute its squared distance from the mean μ, then average those squared distances. Squaring serves two purposes: it makes all deviations positive (no cancellation between outcomes above and below the mean), and it heavily penalizes large deviations, making variance more sensitive to outliers than the mean absolute deviation. In practice, the equivalent shortcut formula Var(X) = E(X²) − [E(X)]² is faster to compute and avoids calculating each deviation individually. The standard deviation σ = √Var(X) simply restores the original units — if X is measured in dollars, variance is in dollars-squared and standard deviation is in dollars.

The two scaling rules are essential. First, adding a constant b to X shifts every outcome by the same amount, so the shape of the distribution doesn't change and neither does its spread: Var(X + b) = Var(X). Second, multiplying X by a stretches each deviation by a factor of a, so squared deviations grow by a²: Var(aX) = a²Var(X). Combined: Var(aX + b) = a²Var(X). The corresponding rule for standard deviation follows: SD(aX + b) = |a|·SD(X). Note that the constant b vanishes entirely.

The independence rule is where students most often stumble: for independent X and Y, Var(X + Y) = Var(X) + Var(Y). This looks obvious but conceals a trap — standard deviations do not add. If σ_X = 3 and σ_Y = 4, then σ_{X+Y} = √(9 + 16) = √25 = 5, not 7. The 3-4-5 right triangle is appearing: standard deviations combine like perpendicular vectors, not like collinear ones. Without independence, the formula becomes Var(X + Y) = Var(X) + 2Cov(X, Y) + Var(Y), where the covariance term captures the dependence between X and Y. The independence rule is the special case where that covariance is zero.

Practice Questions 3 questions

Prerequisite Chain

Counting to 10Counting to 20Understanding ZeroThe Number ZeroCounting to FiveOne-to-One CorrespondenceCombining Small Groups Within 5Addition Within 10Addition Within 20Two-Digit Addition Without RegroupingTwo-Digit Addition with RegroupingAddition Within 100Repeated Addition as MultiplicationMultiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Two-Digit by One-Digit DivisionDivision with RemaindersRemainders and Quotients in DivisionDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueIntegers and the Number LineOpposites and Additive InversesAbsolute ValueAdding IntegersSubtracting IntegersMultiplying IntegersDividing IntegersUnit RatesProportionsPercent ConceptConverting Between Fractions, Decimals, and PercentsOperations with Rational NumbersTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesLiteral EquationsSlope-Intercept FormPoint-Slope FormWriting Linear EquationsParallel and Perpendicular Line SlopesGraphing Linear EquationsPiecewise FunctionsStep FunctionsComposition of FunctionsInverse FunctionsRadical Functions and GraphsRational ExponentsExponential Functions and GraphsGeometric Sequences and SeriesSigma NotationExpected ValueVariance and Standard Deviation of Random Variables

Longest path: 64 steps · 279 total prerequisite topics

Prerequisites (2)

Leads To (17)