What Is Dark Energy: The Force Accelerating the Expansion of the Universe

The Discovery That Changed Cosmology

In 1998, two independent teams of astronomers—the High-Z Supernova Search Team led by Brian Schmidt and Adam Riess, and the Supernova Cosmology Project led by Saul Perlmutter—made one of the most unexpected and consequential discoveries in the history of science. Measuring the distances and recession velocities of Type Ia supernovae in distant galaxies to map the expansion history of the universe, both teams found the same shocking result: the expansion of the universe is not slowing down as gravity would dictate, but accelerating. The universe is flying apart ever faster. For this discovery, Perlmutter, Schmidt, and Riess shared the 2011 Nobel Prize in Physics.

This discovery demanded an explanation. Something must be driving the acceleration—some form of energy that pervades all of space and acts repulsively, counteracting and overcoming the attractive force of gravity on the largest scales. Astronomers called this unknown entity dark energy. Today, dark energy is estimated to comprise approximately 68% of the total energy content of the universe, with dark matter making up about 27% and ordinary matter (everything we can see and touch) constituting just 5%. We live in a universe whose dominant component we do not understand.

Dark energy is not merely a cosmological curiosity—it determines the ultimate fate of the universe. If dark energy remains constant, the universe will expand forever, growing cold and dark over hundreds of billions of years. If dark energy grows stronger over time, it could eventually tear apart galaxies, stars, planets, and even atoms in a scenario called the Big Rip. If dark energy weakens and the universe's expansion slows, a Big Crunch might eventually occur. The nature of dark energy is therefore one of the most consequential open questions in science.

The Cosmological Constant: Einstein's "Greatest Mistake"

The simplest and most natural explanation for dark energy is Einstein's cosmological constant, denoted by the Greek letter Lambda (Λ). Einstein originally introduced the cosmological constant in 1917 as a fudge factor in his general relativity equations to produce a static universe—the prevailing belief at the time. When Edwin Hubble demonstrated in 1929 that the universe was expanding, Einstein reportedly called the cosmological constant his "greatest mistake" and abandoned it. Ironically, the 1998 discovery of accelerating expansion resurrected it, and the cosmological constant is now the centerpiece of the standard cosmological model, known as ΛCDM (Lambda Cold Dark Matter).

Physically, the cosmological constant corresponds to the energy density of empty space—the vacuum energy. Quantum field theory predicts that the quantum vacuum is not truly empty but seething with virtual particles constantly popping in and out of existence, and that these virtual fluctuations should contribute to a nonzero vacuum energy density. The problem is that naive quantum field theory calculations predict a vacuum energy density roughly 10¹²⁰ times larger than the observed value of dark energy—the worst discrepancy between theory and observation in the history of physics, known as the cosmological constant problem or vacuum catastrophe.

Some form of cancellation mechanism must reduce the quantum vacuum energy to its observed near-zero value, but no satisfactory theoretical explanation has been found. Supersymmetry, which would cause bosonic and fermionic contributions to vacuum energy to cancel, was a popular candidate, but the Large Hadron Collider's failure to detect supersymmetric particles at expected energy scales has diminished enthusiasm for this explanation. The cosmological constant problem is one of the deepest unsolved problems in fundamental physics, sitting at the intersection of quantum mechanics, quantum field theory, and general relativity.

Quintessence and Dynamic Dark Energy

An alternative class of dark energy models proposes that dark energy is not a fixed constant but a dynamic field that evolves over time. These models are collectively called quintessence, named after the hypothetical fifth element of ancient philosophy (alongside earth, water, fire, and air). In quintessence models, a scalar field—similar to the inflaton field proposed to drive cosmic inflation—slowly rolls down a potential energy landscape, its energy density changing gradually over cosmic time.

Unlike the cosmological constant, quintessence allows dark energy's density to vary with time and even with position in space. This has observational consequences: if dark energy is dynamic, the equation-of-state parameter w (the ratio of its pressure to its energy density) would deviate from the -1 predicted by the cosmological constant and might vary over time. Current observations constrain w to be very close to -1, consistent with the cosmological constant, but not precisely enough to rule out dynamic dark energy models with slowly varying w.

In 2024, the Dark Energy Spectroscopic Instrument (DESI) released its first-year results, finding a mild preference (at about 3σ statistical significance) for dark energy that is changing over time, with w deviating from -1. If confirmed with higher statistical significance in future data, this would be extraordinary evidence that dark energy is not the cosmological constant but something more dynamic and interesting. The result requires confirmation from independent experiments, and the cosmological community is watching DESI's future data releases with great anticipation.

How We Measure Dark Energy

Type Ia supernovae remain one of the primary tools for measuring dark energy. These stellar explosions occur when a white dwarf in a binary system accretes enough material to reach a critical mass and ignite a runaway nuclear explosion. Because the explosion always occurs near the same mass threshold, Type Ia supernovae have nearly uniform intrinsic peak luminosities (with known corrections), making them "standard candles" that can be used to measure astronomical distances. Comparing measured distances to recession velocities mapped the expansion history and revealed the acceleration.

Baryon acoustic oscillations (BAO) provide a complementary dark energy probe. In the early universe, sound waves propagating in the hot plasma of baryons and photons left a characteristic imprint on the distribution of matter at a fixed physical scale—about 490 million light-years in today's universe. This "ruler" scale, visible as a statistical feature in the three-dimensional distribution of galaxies, can be measured at different cosmic epochs to trace the expansion history. The DESI survey, mapping tens of millions of galaxies, uses BAO as its primary dark energy probe and is currently the largest galaxy survey ever conducted.

Weak gravitational lensing—the subtle distortion of background galaxy shapes by the gravitational pull of foreground matter—provides information about the growth of large-scale structure over time, which is sensitive to dark energy because dark energy suppresses structure growth. The Euclid space telescope, launched in 2023 by the European Space Agency, will map the shapes of over a billion galaxies to constrain dark energy through both BAO and weak lensing. The Vera C. Rubin Observatory, beginning its Legacy Survey of Space and Time (LSST) in 2025, will complement Euclid with its own weak lensing and supernova measurements from the ground, creating an unprecedented dataset for dark energy science.

Dark Energy and the Fate of the Universe

The ultimate fate of the universe depends critically on the nature and evolution of dark energy. In the standard ΛCDM cosmology, with a constant cosmological constant, the expansion continues indefinitely. Galaxies beyond the Local Group are already receding from us faster than the speed of light (which is permitted—it is space itself that is expanding, not objects moving through space), and the accelerating expansion will eventually sweep even nearby galaxies beyond our cosmological horizon. In the very long term—trillions to quadrillions of years—the last stars will burn out, black holes will evaporate via Hawking radiation, and the universe will approach a cold, sparse, dark equilibrium.

If dark energy is truly the cosmological constant, the universe reaches this cold death in the extremely distant future. But if dark energy's energy density increases with time—a form called phantom energy with w less than -1—the expansion would accelerate ever more rapidly, eventually reaching infinite expansion rate in finite time. This scenario, the Big Rip, would tear apart galaxy clusters, then galaxies, then solar systems, then planets, then atoms in succession. The Big Rip would occur in a finite time (perhaps 20 billion years from now under some phantom energy models), culminating in a complete rending of the fabric of spacetime.

Alternatively, if dark energy decays or reverses—something most current models do not predict but cannot rule out—the expansion would slow, reverse, and the universe could recollapse in a Big Crunch. Some cyclic cosmology models even propose that this collapse would trigger a new Big Bang, with the universe bouncing through endless cycles of expansion and contraction. These are fascinating theoretical possibilities, but current observations strongly favor continued expansion under a near-constant dark energy. The mystery of dark energy is not merely academic—it is the mystery of where the universe is going and how it will end.

Dark Energy, Dark Matter, and the Cosmic Inventory

Dark energy and dark matter are often mentioned together but are completely distinct phenomena. Dark matter exerts gravitational attraction, clustering around galaxies and galaxy clusters to form the cosmic web of filaments and voids that structures the universe on large scales. Dark energy exerts repulsion, acting uniformly throughout space and driving the accelerating expansion. Dark matter was inferred from its gravitational effects in the 1930s (Fritz Zwicky) and 1970s (Vera Rubin); dark energy was inferred from the accelerating expansion in 1998.

Together, they constitute the "dark sector"—the 95% of the universe that is invisible to our telescopes and instruments in conventional ways. Ordinary matter—protons, neutrons, electrons, photons, neutrinos—the stuff of which stars, planets, and people are made—is a mere 5% of the cosmic energy budget. This is one of the most humbling realizations of 20th-century science: everything we have ever seen, touched, or measured represents a tiny minority of what exists. The universe is mostly dark, mostly unknown, and mostly mysterious.

The next decade promises transformational advances in dark energy science. The combined datasets from DESI, Euclid, Rubin Observatory, and the Nancy Grace Roman Space Telescope will measure the expansion history and growth of structure with such precision that they will either confirm the cosmological constant model with extraordinary accuracy or definitively detect deviations that would point to new physics. Future gravitational wave detectors like LISA will measure dark energy through an independent method—using binary neutron star mergers as gravitational wave standard sirens to measure the Hubble constant and expansion history. Dark energy was discovered by accident, investigating something else entirely. The next major breakthrough in understanding it may come equally unexpectedly, from whatever corner of physics and cosmology we are not currently watching.