Astronomy & Celestial Mechanics
the sky, computed
Series

Detection bias — the series

8 essays on one idea, from the one that introduces it to the one that assumes the rest.
  1. What each method can see. Planet mass against orbital distance, both logarithmic, with the detection threshold of each method drawn as the boundary it actually is. Radial velocity at 1 m/s needs mass rising as √a; astrometry at 20 µas needs it falling as 1/a, which is the only method that gets easier further out; a 100 ppm transit is a threshold on radius and so a horizontal line at about 1.4 Earth masses, cut off at 1.21 AU by the need for three transits in 4 years; direct imaging begins outside the diffraction limit, 0.6 AU at 10 parsecs for a 39 m aperture at 10 µm. The solar system is drawn on top: for two decades every one of its planets except Jupiter lay outside every region, which is the whole of what the early census was measuring.

    Every survey draws a different sky

    The first exoplanets found were enormous and impossibly close to their stars. That was not a discovery about planets. It was a measurement of what a 10 m/s spectrograph watching for three years is able to see.

    part 1 · exoplanets
  2. What comes back is a ramp, not a threshold. Detection efficiency against signal-to-noise: the fraction of synthetic transits injected into real photometry that the pipeline afterwards finds. The measured curve is a gamma cumulative distribution of shape 4.65 and scale 0.98 beginning at 4.1, which is the form a survey's own injection tests are fitted with; the dashed line is the step at 7.1 that a threshold calculation assumes instead. Half the injections are recovered at 8.33, 1.2 units above the nominal threshold — the ramp is a property of the search and the cut is a separate decision, so the two need not meet anywhere in particular. The rest of the disagreement is the area between the curves. The pipeline does not reach 99 per cent efficiency until 14.9, four units above the threshold, and it recovers 45 per cent one unit above it. Over a population whose signal-to-noise falls as s^-2 — which is what a planet population looks like, because there are far more small planets than large ones — the step function counts 1.21 times as many detections as the ramp does. That factor is not an error bar. It multiplies every occurrence rate computed without it, and it is larger for the small planets than for the large ones, because the small ones live where the ramp is.

    The threshold that is not a threshold

    A survey's detection limit is quoted as a number — seven point one — and a pipeline does not behave that way. Half the injected signals come back at the threshold, and full efficiency arrives four units above it.

    part 2 · exoplanets
  3. Three biases against eccentricity, and they do not agree. Four quantities against orbital eccentricity, each relative to a circular orbit of the same semi-major axis, averaged over the argument of periastron. The transit probability rises as (1 − e²)⁻¹, because an eccentric planet spends part of its orbit inside its own semi-major axis: at e = 0.5 a transit is 1.33 times as likely. The transit duration falls as √(1 − e²), so the event carries less signal-to-noise, and the two together — probability times the square root of the time in transit — come to 1.24 at the same eccentricity. They very nearly cancel, and that is the surprise: a transit survey has almost no eccentricity bias at all. The radial-velocity curve is the one that does. A Keplerian of eccentricity e puts less of its variance in the fundamental and more into harmonics no sinusoidal search is looking at — 68 per cent remains at e = 0.6 and 47 per cent at e = 0.8 — so a velocity survey loses amplitude exactly where a transit survey does not. What no figure here can show is which of these the measured eccentricity distribution is made of, because the correction depends on a detection pipeline rather than on geometry, and the two surveys have to be corrected separately before their answers can be compared.

    Every method prefers a circle, and not for the same reason

    A transit is more likely on an eccentric orbit and shorter when it happens, and the two very nearly cancel. A velocity curve loses amplitude to harmonics no sinusoidal search is looking at, and that one does not cancel at all.

    part 3 · exoplanets
  4. How many planets a star has is the hardest thing a catalogue measures. The multiplicity distribution a transit catalogue would contain, for systems that all truly hold 5 planets, at four mutual inclination dispersions. 40,000 systems are drawn per dispersion with an isotropic viewing direction and Rayleigh-distributed inclinations about a common plane, at semi-major axes of 12, 16, 21, 27, 34 stellar radii; the bars are conditioned on at least one planet transiting, which is what makes a system appear in a catalogue at all. At 0.5° of dispersion 33 per cent of the detected systems show all 5 planets and the mean apparent multiplicity is 3.13; at 10° it is 1.39, with 68 per cent of them showing exactly one. Every one of those systems has 5 planets. The entire difference between a catalogue of singles and a catalogue of compact multiples is one number that nothing in the light curve measures. And the two effects run in opposite directions: the fraction of stars showing any planet RISES with the dispersion — 8%, 9%, 12%, 19% across the four — because scattering the orbits gives more of them a chance to cross the line of sight, while the number seen per detected star falls by a factor of 2.2. A survey that scatters its systems finds more stars with planets and fewer planets per star, and neither number on its own says which has happened. What no figure here can show is the true dispersion, because the observable is the ratio of those two and a system with fewer planets and a tighter plane reproduces it exactly.

    How many planets a star has is not a measurement

    Draw five thousand identical five-planet systems, scatter their orbital planes by half a degree, and a third of the detections show all five. Scatter them by ten degrees and two thirds show exactly one. Every system has five.

    part 4 · exoplanets
  5. How much too small a planet looks when a second star shares its light. The factor by which a planet's true radius exceeds the radius inferred from its transit, against the mass of an unresolved companion star in units of the Sun's, for a planet transiting a Sun-like primary and for one transiting the companion, with the radius computed in both cases from the diluted depth and the primary's radius. Logarithmic vertical axis. A planet on the primary is diluted by the companion's light alone, and the factor is √(1 + F₂/F₁), never more than √2 = 1.41, reached for an equal twin; for a companion of half a solar mass, whose 3943 K surface gives 4.5 per cent of the primary's light in a Kepler-like band, it is 1.022. A planet on the companion is diluted by the primary's much larger light and measured against the wrong star's radius, and the factor is (R₂/R₁)√(1 + F₁/F₂): 2.6 for the half-solar-mass companion and 4.3 for one of 0.3 solar masses. The two curves meet at √2 for twins. The stars are a main-sequence sketch — power-law radii, a smoothed luminosity law and blackbody spectra — good to tens of per cent in flux ratio.

    The Earth-sized bin is where diluted planets land

    A star with an unresolved companion shares its aperture with that companion's light, and every planet found around either star is measured too small. The error runs one way only, so the smallest radius bin receives planets from every larger one and returns none. With a companion beside three stars in ten, more than a quarter of the planets called Earth-sized are something larger.

    part 5 · exoplanets
  6. More pairs on the target list than in the sky. The fraction of a magnitude-limited survey's targets that are unresolved binaries, against the fraction of stars in the volume that are, for companions with mass ratios spread evenly between a tenth and one. For solar-type stars, of which about 45 per cent have a companion, the target list holds 53 per cent binaries if the stars fill space uniformly, 50 if the survey reaches beyond the disc. The excess is modest on average because most companions are faint; it is concentrated in the near-equal pairs, which a magnitude limit over-represents by up to a factor of 2.8.

    A target list that counts pairs twice

    A planet survey chooses its stars by how bright they look, and an unresolved pair of stars looks brighter than either alone. A twin pair is seen from 2√2 times the volume a single star is, so a magnitude-limited target list holds more binaries than the Galaxy does, weighted towards exactly the near-equal pairs that dilute a transit most. The survey then counts its planets per target, and a target is not a star.

    part 6 · exoplanets
  7. Where each test can name the host. The plane of a pair's separation and brightness difference, divided by which measurement can say which star a 1000-ppm transit crossed. Above Δm ≈ 4 a sub-Neptune on the companion is diluted below detection and there is nothing to assign. Imaging resolves the pair to the right of an illustrative contrast curve, Δm = 5 log(s/0.04″). The centroid's shift, read against the pair's separation and flux ratio, names the host to the right of s = σ(1 + f)/δ for a precision σ of 30 μas, about 0.05″ for near twins. The density from the transit's shape names it between Δm ≈ 1.1, below which the two stars are too alike, and the detection limit — at any separation, but only for strong transits on nearly circular orbits. The corner of close, nearly equal pairs, under about 0.04″ and 1.1 magnitudes, is reached by none.

    A transit that says which star it crossed

    When a planet transits one star of an unresolved pair, the catalogue usually assumes the brighter star. The light curve itself can say otherwise, in two ways: the transit's shape measures the density of the star crossed, and a red dwarf is three times denser than the Sun; and the centre of the pair's light moves during the transit, away from whichever star was dimmed. Each test works where the other fails, and between them they leave a corner of close, nearly equal pairs that no measurement of the transit reaches.

    part 7 · exoplanets
  8. The bands of sky from which each planet would be seen to transit. Ecliptic latitude against ecliptic longitude, with the vertical scale stretched 11 times: the band from which each of Mercury, Venus, Earth, Mars, Jupiter would be seen to cross the Sun's disc. The Earth's band lies along the ecliptic, ±0.266° wide. Mercury's is the widest, ±0.69°, and tilted by its 7° inclination; the giants' are narrow, ±0.051° for Jupiter. Each crosses the Earth's at the two nodes of its orbit, and only near those crossings can an observer see two planets transit. From nowhere on the sky can more than 3 be seen.

    The stars that could catch the Earth in transit

    The geometry that lets one Earth twin in two hundred be seen crossing its star works in reverse: the Earth crosses the Sun for observers in a band of sky half a degree wide, under half a per cent of the sky. About two thousand stars within a hundred parsecs sit in it. The band is fixed to the Earth's orbit and the stars are not, so the list changes on the timescale of recorded history — and from no direction can more than three of the eight planets be seen transiting at once.

    part 8 · exoplanets

All series