A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Normal Linear Regression Model

Graduate Depth 120 in the knowledge graph ☐ I know this ☆ Set as goal
4topics build on this
695prerequisites beneath it
See this on the map →
Linear TransformationsNormal Distribution: Properties and Fundamentals+4 more→→F-Statistic for Overall Model SignificanceT-Statistic for Individual Coefficients
regression normality inference assumptions

Core Idea

The normal regression model assumes u ~ N(0,σ²) in addition to OLS assumptions. This distributional assumption enables hypothesis testing and confidence intervals via t and F statistics, allowing exact inference in finite samples rather than relying on asymptotics.

Explainer

From simple linear regression, you know how to estimate coefficients by minimizing the sum of squared residuals. OLS gives you β̂ with desirable properties under the Gauss-Markov assumptions: it's unbiased and efficient among linear estimators. But those properties say nothing about the *distribution* of β̂ — without knowing the shape of that distribution, you cannot make probability statements about how far your estimate might be from the truth. That's where the normal linear regression model comes in: by adding one additional assumption about the error term's distribution, you unlock the entire apparatus of hypothesis testing and confidence intervals without needing large samples.

The new assumption is that the error terms follow a normal distribution: u ~ N(0, σ²). This is a strong claim — you're asserting not just that errors have mean zero and constant variance (the Gauss-Markov assumptions), but that they're drawn from a bell-shaped distribution. Once you make this assumption, a remarkable thing happens: because OLS is a linear function of the errors, and because linear combinations of normal random variables are also normal, the OLS estimator β̂ is itself normally distributed. Specifically, β̂ ~ N(β, σ²(X'X)⁻¹). You now have the exact sampling distribution of your estimator — not an approximation, but the precise distribution.

This sampling distribution is what makes inference possible. The t-statistic for testing whether a coefficient βⱼ equals some hypothesized value β₀ is (β̂ⱼ - β₀) / se(β̂ⱼ), where the standard error is estimated from the data. Under the null hypothesis and the normality assumption, this statistic follows an exact t-distribution with (n-k) degrees of freedom — where n is sample size and k is the number of parameters including the intercept. Similarly, the F-statistic for testing joint hypotheses (does this entire set of coefficients equal zero?) follows an exact F-distribution under the null. These are finite-sample results: they hold exactly even in small samples, not just approximately as sample size grows.

Without the normality assumption, you can still do inference — but only asymptotically, by appealing to the Central Limit Theorem. As n → ∞, the distribution of β̂ converges to normal regardless of the distribution of the errors (under mild regularity conditions), so t and F tests remain valid approximately in large samples. The practical implication: in small samples, the normality assumption is load-bearing. If you have 15 observations and your errors are highly skewed, your t-test p-values may be meaningfully wrong. In large samples — say, 500+ observations — the asymptotic justification is usually sufficient, and the normal regression model becomes a special case of the more general asymptotic theory rather than a necessary restriction. This is why econometrics courses introduce the normal model first for clean finite-sample theory, then relax it for the large-sample results that dominate applied work.

Practice Questions 5 questions

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Number Bonds to 10 → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Dividing Integers → Unit Rates → Proportions → Percent Concept → Converting Between Fractions, Decimals, and Percents → Operations with Rational Numbers → Two-Step Equations → Solving Multi-Step Equations → Equations with Variables on Both Sides → Angle Pairs: Complementary, Supplementary, and Vertical → Parallel Lines and Transversals → Corresponding Angles → Alternate Interior Angles → Triangle Angle Sum Theorem → Exterior Angle Theorem → Triangle Inequality Theorem → Similar Triangles: AA Similarity → Similar Triangles: SSS and SAS Similarity → Proportions in Similar Triangles → Right Triangle Trigonometry Introduction → Sine, Cosine, and Tangent Ratios → Trigonometric Ratios Review → Radian Measure → Converting Between Degrees and Radians → The Unit Circle → Graphing Sine and Cosine → Graphing Tangent and Reciprocal Trigonometric Functions → Derivatives of Trigonometric Functions → Antiderivatives → Indefinite Integrals → Basic Integration Rules → Riemann Sums → Definite Integral Definition → Probability Density Functions and Continuous Distributions → Cumulative Distribution Functions → Continuous Random Variables → Probability Density Functions → Expected Value → Weak Law of Large Numbers → Probability Axioms and Rules → Conditional Probability → Independence of Events → Sampling Distributions → Standard Error of Estimators → Hypothesis Testing: Framework and Logic → P-values and Statistical Significance → Effect Size and Practical Significance → Hypothesis Testing: Framework and Logic → Z-Tests and T-Tests for Means → One-Sample Z-Test for Means → One-Sample and Two-Sample T-Tests → Inference in Linear Regression → Prediction Intervals in Regression → Linear Regression Basics → Residuals and Goodness of Fit (R²) → Simple (Bivariate) OLS Regression → Classical OLS Assumptions (Gauss-Markov) → Multiple Regression → Interpreting Regression Coefficients → Hypothesis Testing in Regression → F-Test and Joint Significance → R-Squared and Model Fit → Multicollinearity → Robust Standard Errors → Panel Data: Structure and Advantages → Fixed Effects Models → Difference-in-Differences → Parallel Trends Assumption: Validity and Testing → Normal Linear Regression Model

Longest path: 121 steps · 695 total prerequisite topics

Prerequisites (6)

Leads To (2)