Cosmological Constant and Dark Energy

Core Idea

The cosmological constant Λ, introduced by Einstein in 1917 to allow a static universe and later "retracted" when expansion was discovered, is now understood as the simplest model of dark energy — the component driving the observed accelerating expansion of the universe. In the field equations G_μν + Λg_μν = (8πG/c⁴)T_μν, the Λg_μν term acts as a perfect fluid with equation of state p = -ρc² (w = -1) and constant energy density ρ_Λ = Λc²/(8πG). Its negative pressure produces gravitational repulsion, accelerating the expansion. Dark energy constitutes about 68% of the total energy density of the universe. The observed value Λ ~ 10⁻⁵² m⁻² is 120 orders of magnitude smaller than the naive quantum field theory prediction for vacuum energy — the "cosmological constant problem," widely considered the worst fine-tuning problem in physics.

Explainer

Einstein introduced the cosmological constant Λ in 1917 as a modification to his field equations to allow a static universe — at the time, the prevailing belief was that the universe was eternal and unchanging. The term Λg_μν on the left side of the equations provides a repulsive effect that can balance the attractive gravity of matter. When Hubble's 1929 observations established that the universe is expanding, the motivation for Λ evaporated, and Einstein reportedly called it his "greatest blunder." For most of the 20th century, Λ was set to zero by convention.

The dramatic reversal came in 1998, when two independent supernova survey teams discovered that the expansion of the universe is accelerating. Type Ia supernovae at redshift z ~ 0.5-1 appeared fainter (farther away) than expected in a decelerating matter-dominated universe. The most natural explanation within GR is a positive cosmological constant Λ > 0, which produces a repulsive gravitational effect that overwhelms matter's attractive gravity at late times. In the Friedmann acceleration equation ä/a = -(4πG/3)(ρ + 3p/c²) + Λ/3, the cosmological constant contributes positively to ä, driving accelerating expansion when Λ dominates over the matter term.

The cosmological constant can be equivalently interpreted as the energy density of empty space — vacuum energy. When the Λg_μν term is moved to the right side of the Einstein equations, it acts as a stress-energy tensor with constant energy density ρ_Λ = Λc²/(8πG) ≈ 6 × 10⁻¹⁰ J/m³ and pressure p_Λ = -ρ_Λc² (equation of state w = -1). This negative pressure, paradoxically, drives repulsive gravity — in GR, the gravitational effect of pressure is proportional to ρ + 3p/c², and for Λ this is -2ρ_Λ, which is negative. The vacuum energy constitutes about 68% of the total energy density of the universe, with dark matter contributing about 27% and ordinary matter about 5%.

The cosmological constant problem is the most severe fine-tuning problem in theoretical physics. Quantum field theory predicts that the vacuum should have an enormous energy density from zero-point fluctuations of all quantum fields, with a natural scale set by the Planck energy density (~10⁹³ g/cm³). The observed dark energy density is about 10⁻²⁹ g/cm³ — roughly 10¹²⁰ times smaller. Even using a lower cutoff (the electroweak scale ~100 GeV), the predicted vacuum energy exceeds the observed value by ~56 orders of magnitude. Some unknown mechanism must cancel the vacuum energy to extraordinary precision while leaving a tiny residual — or the cosmological constant's smallness has an entirely different explanation (anthropic selection, dynamical relaxation mechanisms, or modifications of gravity). No satisfactory resolution exists, and the problem remains one of the deepest unsolved questions at the intersection of general relativity and quantum field theory.