A map stretched by the thing it measures
Assumes Large-scale structure, Expansion and Virial theorem.
A redshift survey does not measure positions. It measures two angles, which are exact, and a redshift, which is converted into a distance by assuming the galaxy is moving with the expansion and nothing else.
The redshift itself is not the problem. It is not a Doppler shift but a ratio of scale factors, and as a measurement it is superb: a spectrum gives it to a part in ten thousand in a few minutes, for objects a hundred times too faint to have a distance measured any other way. Everything about a redshift survey’s reach depends on that.
The assumption underneath the conversion is what is false, and it is false for every galaxy in the survey. Galaxies fall towards mass, at hundreds of kilometres a second in the field and at over a thousand inside a cluster, and that motion adds to the cosmological redshift indistinguishably. The resulting map is therefore not a map of where things are. It is a map of where things are, displaced along the line of sight by their own velocities — and since the velocities are caused by the very structure being mapped, the displacement is correlated with the structure, which turns it from noise into signal.
Why the two distortions point opposite ways
The distinction is between coherent and random motion, and it maps exactly onto the distinction between a structure that has collapsed and one that has not.
Inside a cluster the galaxies have long since virialised. Their motions are random with respect to the cluster’s centre, with a dispersion of order a thousand kilometres a second, and a thousand kilometres a second corresponds to about ten megaparsecs of apparent radial displacement. A cluster three megaparsecs across therefore appears as a filament thirty megaparsecs long, aimed at the observer. It is the most conspicuous artefact in any redshift map and it is entirely an artefact — the elongation is a factor of ten and it points at the observer from every direction at once, which is how it announces itself.
The effect is large because of an accident of units. A peculiar velocity of a thousand kilometres a second is trivial dynamically, and yet at a Hubble constant near seventy kilometres per second per megaparsec it is fourteen megaparsecs of apparent displacement, which is enormous compared with a cluster. The conversion factor between a velocity and a distance in this subject is a small number, and that is what magnifies a modest motion into a gross distortion. On large scales nothing has collapsed. An overdense region is still growing, and the material around it is falling in coherently: the whole far side moves towards the observer and the whole near side moves away. Converted to distance, that pulls the far side nearer and pushes the near side further, and the structure is compressed along the line of sight.
The infall is the same phenomenon that shows up locally as galaxies departing from a smooth velocity–distance law: a peculiar velocity is a record of the gravitational field integrated over the age of the universe, so a map of infall is a map of where the mass is.
The compression is small — of order ten per cent — and it is not random, so it survives averaging over the whole survey. That is what makes it measurable, and what makes it the point of the exercise.
What the squashing is a measurement of
The amplitude of the large-scale flattening depends on how fast the infall is happening, which depends on how fast structure is growing, which depends on gravity.
Write the growth rate as , the logarithmic rate at which the amplitude of density fluctuations grows with the scale factor. In general relativity with ordinary matter, — a relation that holds across a wide range of expansion histories and that theories of modified gravity generically violate.
The flattening measures multiplied by the amplitude of the fluctuations, and it does so through a very clean geometrical signature: the correlation function acquires a quadrupole. Structure that would be isotropic if positions were true becomes measurably anisotropic in a way that depends only on the angle to the line of sight.
The line of sight is a special direction, and it is the survey’s own. That is the structural fact that makes the whole method work: the universe has no preferred direction, so any anisotropy in the measured clustering must have been introduced by the observation. There is nothing to disentangle it from, because there is nothing else that could have produced it.
What the quadrupole actually looks like
It helps to be concrete about the shape. Plot the correlation function on a plane whose axes are the separation along the line of sight and the separation across it, and contours of constant correlation would be circles if positions were true.
They are not. At small transverse separations the contours are stretched enormously along the radial axis — the fingers. At large separations they are flattened, pushed in along the radial axis by a few per cent. Between the two the contours pass through nearly circular, and the crossover scale is roughly where structures have just stopped collapsing.
A single figure therefore carries both signals, at different radii, produced by the same physics in different regimes. The analysis extracts them by expanding the angular dependence in Legendre polynomials: the monopole is the ordinary isotropic clustering, the quadrupole carries most of the growth signal, and the hexadecapole helps break the remaining degeneracies.
Growth is a different measurement from expansion
This is the part worth sitting with, because it is why anybody goes to the trouble.
Nearly every cosmological measurement in this collection is a measurement of geometry: the expansion history, through distances and angles. Supernova distances, the acoustic scale as a ruler, the angular size of the microwave background’s features — all of them constrain how the scale factor has behaved, and all of them are silent about how structure grew inside it.
Growth is a separate function, and in general relativity it is determined by the expansion history. Given how fast the universe expanded, the rate at which perturbations grew follows with no freedom. So measuring both is a consistency test of the theory rather than two measurements of the same thing.
A concrete instance makes the point. Two models can be constructed that agree exactly on every distance ever measured — the same supernova Hubble diagram, the same acoustic scale, the same microwave background peak positions — and that predict growth rates differing by ten per cent. Nothing geometric distinguishes them. A redshift-space measurement does.
That test is the main reason dark energy is not simply accepted as a modification of gravity. A modified theory can be tuned to reproduce any expansion history — that is only one function — but it will generically predict a different growth rate. Comparing the two therefore separates “the expansion is accelerating because of a new component” from “the expansion is accelerating because gravity is not what is assumed”, which no distance measurement can do.
The bias problem, which does not go away
There is a difficulty sitting underneath all of this and it deserves its own section.
Galaxies are not matter. They form at the peaks of the density field, and peaks are more clustered than the field they are peaks of — so the clustering measured from galaxies is amplified by a bias factor relative to the clustering of the mass. Worse, the bias depends on what kind of galaxy is being counted: luminous red galaxies are more biased than blue star-forming ones, and both are more biased than the mass.
Bias is degenerate with the fluctuation amplitude in every measurement of clustering alone. What redshift-space distortions supply is a way out, because the velocities respond to the total mass rather than to the galaxies. So the ratio of the anisotropic part of the clustering to the isotropic part cancels the bias to leading order, and what survives is the growth rate multiplied by the mass fluctuation amplitude — a combination that is genuinely about the matter.
The other anisotropy, which is geometric
A second distortion afflicts the same map for a completely different reason, and separating the two is a large part of the analysis.
Converting redshifts into distances requires a cosmology, and if the assumed cosmology is wrong the conversion stretches the map by different factors along and across the line of sight. Radial separations are converted using the Hubble rate at that redshift; transverse ones using the angular-diameter distance. Get either wrong and a sphere becomes a spheroid.
Disentangling the two anisotropies is the central technical problem of a modern redshift survey. They have different dependences on scale and on angle, which is what makes it possible, and the fits are done jointly rather than in sequence.
Reconstruction, and undoing the distortion
There is a third use for the velocity field, and it turns the distortion into a repair rather than a measurement.
The infall is caused by the density field, and the density field is what the survey has measured. So the velocities can be estimated from the map itself, and each galaxy moved back along the line of sight by its estimated displacement — a procedure that partly undoes both the distortion and the smearing that gravitational evolution has done to the acoustic scale over ten billion years.
This is not circular, because it does not need to be accurate to be useful. Displacing galaxies by an estimate that is right on average sharpens the acoustic peak in the correlation function substantially, and a sharper peak is a more precise ruler. The improvement is close to a factor of two in the distance precision from the same data, which is why every modern survey does it.
The reconstruction also gives, as a by-product, a map of the velocity field, and that map can then be compared against velocities measured directly for the subset of galaxies with independent distances. Where the two agree, the mass model is right; where they do not, something is missing.
What the fingers are good for
The small-scale distortion is usually treated as a contaminant to be modelled and marginalised over. It is not only that.
The length of the fingers is a direct statistical measurement of the pairwise velocity dispersion of galaxies — a map that is not of positions but of motions — which is a measurement of the mass in the systems they inhabit — a redshift survey therefore contains a mass census that requires no cluster to be identified and no virial equilibrium to be assumed about any individual object. It is a much blunter instrument than weighing a cluster three ways, and it applies to the whole survey at once.
Fitting a simulation instead of a formula
The modelling difficulty described above — that most of the information sits at scales where linear theory has failed and the phenomenological damping is a guess — has produced a change in how the analysis is done, and the change is worth describing because it trades one kind of uncertainty for another.
The older approach writes down an analytic model with a handful of nuisance parameters, restricts the fit to scales where that model has been shown to be unbiased against simulations, and discards everything smaller. The restriction is severe: it throws away the majority of the measured pairs, because the number of pairs at a given separation grows as the cube of the separation only up to the survey’s size and the small separations are where the counts are.
The newer approach fits the simulations directly. A large suite of N-body runs is produced across a grid of cosmological parameters; galaxies are placed into the resulting haloes according to a prescription with its own parameters; the clustering statistics are computed for every run; and a fast interpolator — an emulator — is trained to predict those statistics anywhere in the grid. The survey’s measurements are then compared against the emulator rather than against a formula, and the fit runs down to separations of a megaparsec or less.
What that buys is information. What it costs is that the result now depends on the prescription for how galaxies occupy haloes, which is a model of galaxy formation rather than of gravity, and on the simulations having converged at the scales being used.
The two approaches are not in competition so much as in tension, and the honest position is that they answer slightly different questions. The analytic fit measures a growth rate with a well-understood systematic and a large error bar; the emulator measures a growth rate with a smaller error bar and a systematic that is a modelling choice. Where the two are run on the same data they agree within their errors, which is reassuring and is not the same as either being validated.
There is a third position that is gaining ground and that sidesteps the choice. Rather than fitting a model to a compressed statistic, a field-level analysis attempts to infer the initial conditions of the observed volume directly — the density field that, evolved forward through gravity and through a galaxy-formation prescription, reproduces the catalogue galaxy by galaxy. The velocities then come out as a by-product rather than being inferred from an anisotropy at all, and the distinction between the two distortion regimes disappears, since a forward model produces both automatically.
Whether that is progress depends on something the method cannot check about itself. Inferring a field with millions of degrees of freedom from a catalogue requires a prior, and the prior is that the initial conditions are a Gaussian random field with a spectrum the analysis is also fitting. Where that is right the method is close to optimal; where it is wrong the failure is not localised to any one statistic and is correspondingly hard to notice.
The scales that carry the most information are the scales where the theory is weakest, and every methodological development in this subject for two decades has been an attempt to move the boundary between them.
Where the picture stops
The small-scale modelling is not first-principles. The transition between the coherent infall regime and the virialised one happens over a range of scales where neither limit applies, and it is handled with a phenomenological damping function whose form is chosen for convenience. Results are quoted only above a scale where that choice demonstrably does not matter, and establishing where that scale is consumes a large fraction of the analysis effort.
Bias is only cancelled to leading order. Beyond the linear approximation the relationship between galaxies and mass involves further parameters, and the cancellation is incomplete. Whether the residual is small enough for the next generation of surveys, which will be an order of magnitude more precise, is an open question rather than a settled one.
Survey geometry leaks into the anisotropy. A survey covering a limited patch of sky has a window function that is itself anisotropic with respect to the line of sight, and its effect on the measured multipoles has to be computed and divided out. On a small or oddly shaped field the correction is not small, which is one reason the field has moved towards surveys covering enormous contiguous areas.
And the observer’s own motion has to be removed first. The Sun moves at some 370 kilometres a second with respect to the microwave background, which is a dipole in every redshift in the survey. It is subtracted using the background’s own dipole — which assumes that dipole is entirely kinematic, an assumption that is itself under examination.
Where this ladder goes next
Later rungs on this anchor: the multipole decomposition in detail, and which combinations of growth, bias and amplitude each moment constrains; direct peculiar-velocity surveys using distance indicators, which measure the velocity field rather than inferring it; the cross-correlation of galaxy positions with lensing maps, which breaks bias by a second route; the void statistics, where the distortions have the opposite sign and different systematics; and the joint fit with the acoustic scale, which is how one survey delivers a growth rate and two distances at once.
About the same objects
Not linked from either essay — found by the objects both name.
- A ruler measured along and across anisotropic clustering · correlation function · redshift space distortion
What links here
Essays that link to this one from their own argument.
- A velocity that has the colour of the sky cosmology
- Spin acquired before there was anything to spin cosmology
- A test that can only fail one way cosmology
The objects this essay names
Each one links to every other essay that touches it.
Alcock paczynski testAnisotropic clusteringCorrelation functionFingers of GodGrowth rateKaiser effectLinear biasModified gravityPeculiar velocityRedshift space distortionStructure growthVelocity dispersion