The number that would say whether it is a constant
Assumes Dark energy, Baryon acoustic oscillations and Supernovae.
The rung below found an acceleration nobody was looking for: two teams set out to measure how fast the expansion was slowing, and both found a quarter of a magnitude of extra faintness at redshift a half, which is the wrong sign.
A quarter of a magnitude is a large signal and it was measured convincingly within a few years. The question that followed is a very much harder one, and the fact that it is harder by an order of magnitude is the whole content of this rung.
Something is accelerating the expansion. Is it a constant?
What w is
The energy density of any component of the universe evolves as
where is the ratio of its pressure to its energy density. Matter has and dilutes as ; radiation has and dilutes as , with the extra factor from the redshifting of each photon, and the budget the three make up is five parts ordinary matter in a hundred.
A cosmological constant has exactly, and therefore does not dilute at all: the same energy density in every cubic metre for ever, unchanged as the metres multiply. That is a strange substance and it is also the simplest possible one, because it has no parameters — it is a constant of nature, or a term in the field equations, and there is nothing about it that could vary.
Anything else is a field. A slowly rolling scalar field has close to but not equal to it, and generically varying with time. There is no shortage of candidates; there is a complete shortage of predictions, since the models can be built to give almost any near .
So the measurement is: is exactly ? A confirmed departure of any size would rule out a cosmological constant outright and open the field to physics.
Why the signal is small
Changing from to changes the dark energy density’s behaviour by a thirty-per-cent tilt over the observable range of redshift. That sounds large. What it does to a distance is not.
Distance is an integral of , and contains the dark energy only through a term that is a third of the total at redshift one and less beyond. Integrating over redshift smears the difference further. The net effect at redshift a half is 0.034 magnitudes.
A type Ia supernova, after standardisation by its light-curve shape and colour, has an intrinsic scatter of about 0.12 magnitudes. The signal is a fifth of the noise on one object.
The measurement therefore does not exist for any individual supernova. It exists only as a statistical statement about a sample, and the error on the mean of objects is — three millimagnitudes for fifteen hundred, which is a ten-sigma detection of the difference between and .
The systematic floor
The square root does not go on for ever, and where it stops is the actual limit of the field.
Averaging reduces the random scatter. It does nothing at all to an error common to the whole sample, and a distance modulus is a difference of magnitudes measured through filters, calibrated against standard stars, corrected for dust, and compared between high- and low-redshift objects observed with different instruments in different bands.
Every one of those steps has a systematic at the ten-to-thirty-millimagnitude level, which is the same size as the entire signal.
Photometric calibration. The zero points of the photometric system have to be transferred between telescopes and between bandpasses, and the current best-effort calibration of a supernova sample is uncertain at about 0.01 magnitudes.
Dust. Extinction reddens and dims, and separating it from a supernova’s own intrinsic colour variation requires assuming a reddening law. Whether that law is the same in every host galaxy is not known, and it is the leading systematic in most modern analyses.
Evolution. High-redshift supernovae explode in younger, more metal-poor galaxies than nearby ones. If the standardisation depends on host properties — and there is evidence that it does, at the 0.05-magnitude level — then the comparison across redshift carries a drift that mimics a change in .
The other reason the sample is not just numbers
Standardisation is a two-parameter correction and both parameters have to be fitted from the sample itself, which introduces a subtlety worth naming because it costs precision that a naive count does not show.
The observed peak magnitude is corrected as
with the light-curve stretch and the colour, and and fitted simultaneously with the cosmology. That means the cosmological parameters and the standardisation parameters are correlated: a change in can be partly absorbed by a change in , and the error on includes the error on .
Worse, appears to depend on the host galaxy — split the sample by host stellar mass and the two halves prefer different values, by an amount that is significant and that nobody can derive. The standard treatment is to fit the two halves separately and quote the difference as a systematic, which is honest and is not an explanation.
The degeneracy
Even with a perfect sample there is a second problem, and it is geometric rather than statistical.
The distance to a given redshift depends on and on together, and over the redshift range supernovae reach, a change in one can be nearly cancelled by a change in the other. Increasing and making more negative both slow the recent expansion, and the combination that leaves the distances unchanged is a curve in the plane rather than a point.
The curve is not a sketch: for each there is a specific minimising the difference in distance modulus over the sample’s redshift range, and that locus is what the lower panel of the first figure draws.
What cuts across it is a measurement that depends on the same parameters differently. The microwave background fixes the angle the sound horizon subtends at last scattering, and therefore the comoving distance to redshift 1090 — an integral over the whole history rather than the recent part. And it fixes the physical matter density very well from the ratios of the acoustic peak heights.
Holding fixed and requiring the same distance to last scattering gives a second locus, running at a large angle to the first. Their intersection is the measurement.
The third measurement, which is the same ruler at low redshift
There is a third constraint and it is the cleanest of the three, because it uses the same physical ruler at a completely different epoch.
The sound horizon imprinted on the microwave background is also imprinted on the distribution of galaxies, as a slight excess of pairs separated by about 150 megaparsecs. Measuring that scale in a galaxy survey at redshift 0.5 gives a distance; measuring it along the line of sight gives directly rather than an integral of it.
That last point matters. Supernovae measure integrated distance and therefore respond to weakly and with a lag; a direct measurement of at a redshift where dark energy matters responds to immediately.
Why the three probes are combined rather than compared
It is tempting to treat three measurements of the same quantity as three independent checks, and the way they are actually used is different and worth setting out.
They are not three measurements of . None of them measures at all on its own. Supernovae measure relative distances over ; the microwave background measures one distance to and two densities; galaxy surveys measure a distance and an expansion rate at a few redshifts in between. Each constrains a combination of , and , and each combination is different.
The value of the combination is therefore geometric rather than statistical. Two loci crossing at thirty-six degrees give a small intersection; two crossing at five degrees give a long thin one, however precise each is. That is why the quoted improvement from adding the acoustic scale to the supernovae is a factor of several rather than the modest gain that adding an independent measurement of equal precision would give.
It also means a systematic in one probe propagates into the joint answer in a direction set by the geometry rather than by its own size — which is the reason every joint analysis publishes the result with each probe removed in turn.
What the answer currently is
Combining supernovae, the acoustic scale in the microwave background, and the acoustic scale in galaxy surveys gives
consistent with a cosmological constant.
Three things about that number deserve saying.
It assumes is constant. Fitting a time-varying instead — usually parameterised as — gives constraints that are far weaker and that have shown mild departures from a constant in some recent combinations of data, which is currently the most interesting unresolved question in the field.
It assumes flatness. Allowing curvature as a free parameter widens the constraint on substantially, because curvature and dark energy affect distances in similar ways.
And 0.03 is close to the systematic floor. Doubling the supernova sample would improve the statistical error by 30 per cent and the total by very little, which is why the effort has moved to the geometric probes and to controlling calibration rather than to collecting more objects.
Why a pressure accelerates anything
The ratio of pressure to energy density is an odd thing for a cosmological measurement to be about, and the reason it is the right variable is worth a section, because it is the one step of the argument that has no Newtonian analogue at all.
In Newtonian gravity, pressure does not gravitate. A gas cloud’s pull on a distant body depends on its mass and not on how hard it is pushing outward, and pressure enters only through the forces it exerts across surfaces inside the cloud.
In general relativity the source of gravity is not mass but the whole stress–energy tensor, pressure included. The expansion obeys
and the second term inside the bracket is the departure. Every ordinary substance has , so it contributes to the deceleration on top of its own density — a hot gas pulls harder than a cold one of the same mass, which is a genuine and measurable prediction and is one of the ways pressure’s gravitation has been tested.
Setting , the bracket is , which changes sign at . Anything with more negative than a third accelerates the expansion, and that is the whole condition — no substance is required to push, and nothing is being blown apart. A cosmological constant at clears it comfortably; a network of cosmic strings at sits exactly on the boundary and does nothing.
The negative pressure itself is not exotic when written the other way round. A constant energy density means that expanding a volume creates energy in proportion to the volume, and the work done in that expansion is — so the pressure must be negative and equal in magnitude to the energy density, which is arrived at from thermodynamics rather than from the field equations. The strange thing is the constant density, and the negative pressure is its bookkeeping.
The side of minus one that should not be reachable
The measured value is , which is centred on the wrong side of the boundary, and the region below has a name and a set of problems.
Dark energy with is called phantom, and its density grows as the universe expands. Everything else in the budget dilutes; a phantom component does the opposite, so it comes to dominate more and more completely, and the domination runs away. The expansion rate diverges in finite time, and the divergence tears apart structures in order of decreasing binding energy — clusters, then galaxies, then the solar system, then atoms. That is the big rip, and for it is some hundreds of billions of years off.
The theoretical objection is stronger than the eschatological one. A component with violates the null energy condition, and the simplest field theories that produce it have kinetic terms of the wrong sign, which makes the vacuum unstable to producing arbitrary amounts of the field and its negative-energy partner. Nothing that behaves this way is easy to write down as a well-behaved theory.
So the honest reading of is that a value one standard deviation into a region nobody can construct a model for is exactly what a measurement centred on looks like half the time. The result’s interest is in its width and not in its centre, and a determination at that stayed where it is would be a very different statement — which is the specification the next generation of surveys was written to.
What a departure would mean
It is worth stating why three hundredths of a magnitude is worth a generation of instrument-building, because the quantity is abstract and the effort is not.
A cosmological constant is a term that can be written into the field equations with no dynamics attached, and its measured value is about in the natural units the underlying physics is written in. Nobody has an account of that number. It is the largest unexplained ratio in physics, and one standard response is that a constant requires an explanation of a kind that a field would not, because a field can roll to wherever it is now.
So a confirmed would not merely add a parameter. It would say that the thing driving the expansion has dynamics, that it has a history, and that its present value is a consequence rather than a coincidence.
A confirmed to high precision says the opposite, and is the harder result to live with.
What would settle it
Ten thousand supernovae with a calibration good to five millimagnitudes. That is the specification of the surveys now running, and its binding constraint is the calibration rather than the count.
A percent-level acoustic-scale measurement over a wide range of redshift. Spectroscopic surveys of tens of millions of galaxies give the ruler at many epochs, which turns a single distance into an expansion history.
And a measurement of that does not go through a ruler at all. Standard sirens do exactly that, and enough of them with identified hosts would give the expansion rate at several redshifts with systematics that share nothing with any of the above. One more matter density shows how weakly the present composition constrains the past one.
Where this ladder goes next
This rung has taken the question that followed the discovery and shown why it is harder by an order of magnitude: the signal is a fifth of the scatter of one object, it lies along a degeneracy, and the error is now dominated by terms that averaging does not touch.
The rung above is the time dependence. A constant is already a restrictive assumption, and the parameterisation used to relax it has two parameters and a figure of merit built around the area of the ellipse they occupy — which is the quantity every survey since has been designed to shrink.
Beside it lies the alternative that removes dark energy entirely: modifying gravity on large scales rather than adding a substance. The distinguishing observable is not the expansion history, which can be matched, but the growth of structure within it — which is why redshift-space distortions, measuring how fast galaxies fall into overdensities, are the other half of every survey design.
And below it, the habit: a discovery and a measurement of the same thing can differ by an order of magnitude in difficulty. Detecting the acceleration needed a quarter of a magnitude and a hundred objects. Characterising it needs three hundredths of a magnitude and a calibration nobody had, and twenty-five years later the answer is still consistent with the simplest possibility.
About the same objects
Not linked from either essay — found by the objects both name.
- Whether there is a horizon at all cosmological constant · deceleration parameter · equation of state
What links here
Essays that link to this one from their own argument.
- A coincidence that is a factor of fourteen cosmology
- The epoch nobody saw moves the tilt cosmology
- The galaxies that are already out of reach cosmology
- The tilt knows the slope and not the height cosmology
- A mass measured by what it stopped from forming cosmology
- A redshift that changes while it is watched cosmology
- A ruler measured along and across cosmology
The objects this essay names
Each one links to every other essay that touches it.
Acoustic scaleCosmological constantDark energy densityDeceleration parameterDegeneracy directionEquation of stateFigure of meritJoint constraintPhotometric calibrationQuintessenceStandardisationSystematic floor