A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Uniformly Minimum Variance Unbiased Estimation (UMVUE)

Research Depth 113 in the knowledge graph I know this Set as goal
1topic build on this
763prerequisites beneath it
See this on the map →
Cramer-Rao Lower BoundSufficient Statistics+1 moreRao-Blackwell Theorem
umvue unbiased-estimation statistics

Core Idea

A UMVUE is an unbiased estimator with minimum variance among all unbiased estimators. By the Cramer-Rao bound, no unbiased estimator can have variance less than 1/I(θ). A necessary condition for a UMVUE is that it's a function of a complete sufficient statistic. UMVUEs need not always exist, and when they do, they are often difficult to find.

Explainer

From the Cramér-Rao lower bound, you know there is a floor on how small the variance of an unbiased estimator can be: Var(T̂) ≥ 1/I(θ), where I(θ) is the Fisher information. An estimator that achieves this bound is called efficient — it extracts every bit of information the data contain about θ, with no waste. The UMVUE asks: even among unbiased estimators that *don't* achieve the Cramér-Rao bound (because the bound is not always tight), which one has the smallest variance? The UMVUE is the winner of that competition.

The concept of a sufficient statistic is your other prerequisite here. Recall that T is sufficient for θ if the conditional distribution of the data given T does not depend on θ — T captures all the information in the sample about θ. Now add a refinement: T is complete if the only function of T that has zero expectation for all θ is the zero function. Completeness rules out "redundancy" in T — there are no linear combinations of T that are informationally empty. Complete sufficient statistics are rare and special; for exponential family distributions (normal, Poisson, binomial, exponential, etc.), the natural sufficient statistic is always complete.

The key theorem connecting these ideas is the Lehmann-Scheffé theorem: if T is a complete sufficient statistic and h(T) is an unbiased estimator of θ, then h(T) is the UMVUE. The proof uses the Rao-Blackwell theorem as a component: starting from any unbiased estimator, conditioning on T can only reduce variance. So the best unbiased estimator must be a function of T. Completeness then guarantees uniqueness — there can be only one such function, making it the UMVUE.

In practice, finding a UMVUE involves two steps: identify a complete sufficient statistic (often given by the exponential family structure), then find or construct an unbiased function of it. For a Poisson sample, the complete sufficient statistic is the sum ΣXᵢ, and the sample mean X̄ = ΣXᵢ/n is unbiased for λ, making it the UMVUE of λ. UMVUEs are elegant in theory but have limits: they restrict attention to unbiased estimators, and sometimes a slightly biased estimator with much lower mean squared error (like a ridge or Bayes estimator) is preferable in practice. The UMVUE is the best you can do within the unbiasedness constraint — a theoretically optimal benchmark, though not always the most practically useful one.

Practice Questions 5 questions

Prerequisite Chain

Understanding ZeroThe Number ZeroCounting to FiveCounting to 10Counting to 20Counting a Set of Objects Up to 20Cardinality: The Last Number CountedMatching Numerals to QuantitiesSubitizing Small QuantitiesAddition Within 10Number Bonds to 10Addition Within 20Doubles and Near DoublesDoubles Facts Within 10Near Doubles Facts Within 20Mental Math Strategies for AdditionMental Math: Adding and Subtracting TensAddition Within 100Repeated Addition as MultiplicationMultiplication as Equal GroupsMultiplication: ArraysBasic Multiplication Facts (0s, 1s, 2s, 5s, 10s)Multiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Multiplication and Division Fact FamiliesRelationship Between Multiplication and DivisionDivision Facts as Inverse of MultiplicationRemainders and Quotients in DivisionDivision Word ProblemsMulti-Step Word ProblemsSolving Multi-Step Word ProblemsMultiplication Word ProblemsDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueIntegers and the Number LineComparing and Ordering IntegersAbsolute ValueAdding IntegersSubtracting IntegersMultiplying IntegersDividing IntegersUnit RatesProportionsPercent ConceptConverting Between Fractions, Decimals, and PercentsOperations with Rational NumbersTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesAngle Pairs: Complementary, Supplementary, and VerticalParallel Lines and TransversalsCorresponding AnglesAlternate Interior AnglesTriangle Angle Sum TheoremExterior Angle TheoremTriangle Inequality TheoremSimilar Triangles: AA SimilaritySimilar Triangles: SSS and SAS SimilarityProportions in Similar TrianglesRight Triangle Trigonometry IntroductionSine, Cosine, and Tangent RatiosTrigonometric Ratios ReviewRadian MeasureConverting Between Degrees and RadiansThe Unit CircleGraphing Sine and CosineGraphing Tangent and Reciprocal Trigonometric FunctionsDerivatives of Trigonometric FunctionsAntiderivativesIndefinite IntegralsBasic Integration RulesRiemann SumsDefinite Integral DefinitionFundamental Theorem of Calculus Part 1Fundamental Theorem of Calculus Part 2U-SubstitutionPartial Fraction Decomposition for IntegrationImproper Integrals - ConvergenceIntegral TestP-SeriesComparison TestLimit Comparison TestSeries Convergence Test StrategyPower SeriesRadius and Interval of ConvergenceTaylor SeriesMoment Generating FunctionsCharacteristic FunctionsConvergence in DistributionStationary DistributionsConvergence of Markov ChainsConvergence in ProbabilityAlmost Sure ConvergenceRelationships Between Modes of ConvergenceWeak Law of Large NumbersStrong Law of Large NumbersCentral Limit Theorem (Rigorous via Characteristic Functions)Maximum Likelihood Estimation (Theory)Exponential Family of DistributionsConjugate PriorsBayesian Point EstimationUniformly Minimum Variance Unbiased Estimation (UMVUE)

Longest path: 114 steps · 763 total prerequisite topics

Prerequisites (3)

Leads To (1)