A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Confidence Intervals and Hypothesis Tests in Regression

Graduate Depth 125 in the knowledge graph ☐ I know this ☆ Set as goal
1topic build on this
828prerequisites beneath it
See this on the map →
Asymptotic Normality of Regression EstimatorsHypothesis Testing in Regression+2 more→→Prediction Intervals and Out-of-Sample Forecasting
inference hypothesis-testing intervals

Core Idea

Confidence intervals quantify uncertainty around parameter estimates using estimated standard errors and critical values from the t-distribution; hypothesis tests evaluate whether parameters equal specific values. Both rely on asymptotic normality and require valid estimates of standard errors, accounting for any heteroskedasticity or serial correlation.

Explainer

You already know from asymptotic normality that the OLS estimator β̂ is approximately normally distributed in large samples: (β̂ − β) / se(β̂) → N(0,1). A confidence interval uses this fact directly — it constructs a range around β̂ that, under repeated sampling, would contain the true β in 95% of cases (for a 95% interval). The formula is β̂ ± t* · se(β̂), where t* is the critical value from the t-distribution with n − k − 1 degrees of freedom. In large samples, t* ≈ 1.96 for 95% confidence. The interval does not mean "there is a 95% chance β is inside this range" — β is a fixed (unknown) constant, not a random variable. What varies across samples is β̂ itself.

The t-statistic for hypothesis testing is the same building block rearranged. To test H₀: βⱼ = c (typically c = 0, the hypothesis that variable j has no effect), compute t = (β̂ⱼ − c) / se(β̂ⱼ). Under H₀, this statistic follows an approximate t-distribution. A large absolute value of t means the estimate is many standard errors from the hypothesized value — unlikely if H₀ were true. The p-value converts this to a probability: it is the probability of observing a t-statistic at least as extreme as yours if H₀ were true. A p-value below your chosen significance level (commonly 0.05) leads to rejection of H₀.

The confidence interval and hypothesis test are two sides of the same coin: β̂ ± t* · se(β̂) contains exactly the values c for which a two-sided test would fail to reject H₀: βⱼ = c. If zero is inside the 95% confidence interval, the t-test at 5% significance fails to reject H₀: βⱼ = 0. If zero is outside, you reject. This duality gives you two ways to communicate the same inference — the interval conveys both significance and effect magnitude, while the test gives a clean binary decision.

The critical ingredient in all of this is se(β̂) — the estimated standard error. You know from your prerequisites that if errors are heteroskedastic or serially correlated, the classical OLS standard errors are inconsistent; they typically understate the true uncertainty, producing confidence intervals that are too narrow and t-statistics that are too large. This is why valid inference requires using heteroskedasticity-robust or cluster-robust standard errors whenever those problems are present. The formula for β̂ does not change — only the standard errors you attach to it do. Getting this right is not a technical nicety; it is the difference between inference you can trust and inference that will mislead you.

Practice Questions 5 questions

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Number Bonds to 10 → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Dividing Integers → Unit Rates → Proportions → Percent Concept → Converting Between Fractions, Decimals, and Percents → Operations with Rational Numbers → Two-Step Equations → Solving Multi-Step Equations → Equations with Variables on Both Sides → Angle Pairs: Complementary, Supplementary, and Vertical → Parallel Lines and Transversals → Corresponding Angles → Alternate Interior Angles → Triangle Angle Sum Theorem → Exterior Angle Theorem → Triangle Inequality Theorem → Similar Triangles: AA Similarity → Similar Triangles: SSS and SAS Similarity → Proportions in Similar Triangles → Right Triangle Trigonometry Introduction → Sine, Cosine, and Tangent Ratios → Trigonometric Ratios Review → Radian Measure → Converting Between Degrees and Radians → The Unit Circle → Graphing Sine and Cosine → Graphing Tangent and Reciprocal Trigonometric Functions → Derivatives of Trigonometric Functions → Antiderivatives → Indefinite Integrals → Basic Integration Rules → Riemann Sums → Definite Integral Definition → Probability Density Functions and Continuous Distributions → Cumulative Distribution Functions → Continuous Random Variables → Probability Density Functions → Expected Value → Weak Law of Large Numbers → Probability Axioms and Rules → Conditional Probability → Independence of Events → Sampling Distributions → Standard Error of Estimators → Hypothesis Testing: Framework and Logic → P-values and Statistical Significance → Effect Size and Practical Significance → Hypothesis Testing: Framework and Logic → Z-Tests and T-Tests for Means → One-Sample Z-Test for Means → One-Sample and Two-Sample T-Tests → Inference in Linear Regression → Prediction Intervals in Regression → Linear Regression Basics → Residuals and Goodness of Fit (R²) → Simple (Bivariate) OLS Regression → Classical OLS Assumptions (Gauss-Markov) → Multiple Regression → Interpreting Regression Coefficients → Hypothesis Testing in Regression → F-Test and Joint Significance → R-Squared and Model Fit → Omitted Variable Bias → Causal Inference and the Identification Problem → Potential Outcomes and the Rubin Causal Model → Selection Bias → Instrumental Variables → Instrumental Variables: Validity Assumptions → Two-Stage Least Squares (2SLS) → Reduced Form and First-Stage Equations → Test of Overidentification: Hansen J-Test → F-Statistic for Overall Model Significance → T-Statistic for Individual Coefficients → Confidence Intervals and Hypothesis Tests in Regression

Longest path: 126 steps · 828 total prerequisite topics

Prerequisites (4)

Leads To (1)