The observed sky

A population counted by shadows that never repeat

A body a kilometre across at forty astronomical units is a hundred million times too faint to image and casts a shadow just as dark as a large one. Monitoring enough stars fast enough catches those shadows — each one a single unrepeatable event of a fraction of a second, and the measurement is not any event but the rate.

Assumes Occultations and Collisional cascade.

Every occultation described here so far has been predicted. A body’s orbit is known, a star’s position is known, and the shadow’s track across the Earth is computed in advance so that telescopes can be put in it.

There is a whole population for which none of that is possible. Bodies a few kilometres across in the outer solar system are far too faint to have been catalogued — a one-kilometre object at forty astronomical units is around magnitude 35 on a scale that runs backwards — so their orbits are unknown, their positions are unknown, and no event involving one can ever be predicted.

They still cast shadows, and a shadow does not care how faint its caster is. The approach is therefore to stop predicting and start waiting: monitor many stars at high cadence, record everything, and treat an occultation as something that happens rather than something that is arranged.

Below 1.3 km a shadow stops getting smaller. The relative rate at which a star is occulted, against the smallest body a survey can detect, for size distributions with slopes 3.5, 4, 4.5. The cross-section of a body is not its own diameter: diffraction gives every shadow a minimum width of about the Fresnel scale, √(λD/2), which at 40 AU and 550 nm is 1.28 km. Above that the cross-section grows with the body, so lowering the limit gains events as the limit to the power -1.5 for the shallowest distribution drawn; below it the cross-section stops shrinking and only the number of bodies keeps rising, which is a shallower gain by one power. Pushing the limit from 40 km to 0.2 multiplies the rate by 3106196 at the steepest slope and 14131 at the shallowest — so the rate a survey measures is a measurement of the size distribution, which is the quantity a collisional history predicts and nothing else can reach at these sizes.
Fig. 1 The relative rate at which a given star is occulted, against the smallest body a survey can detect, for three size-distribution slopes. The cross-section of a body is not its own diameter: diffraction gives every shadow a minimum width of about the Fresnel scale, λD/2\sqrt{\lambda D/2}, which at forty astronomical units and 550 nanometres is 1.3 kilometres. Above that the cross-section grows with the body; below it the cross-section stops shrinking and only the number of bodies keeps rising. The rate a survey measures is therefore a measurement of the size distribution.

Why a small body casts a shadow bigger than itself

The edge of a shadow is a wave, and that is usually a limitation. Here it is what makes the measurement possible at all.

Light passing an obstacle diffracts, and the scale over which the geometric shadow is blurred into a fringe pattern is the Fresnel zone, λD/2\sqrt{\lambda D/2} — the geometric mean of the wavelength and the distance. At Kuiper belt distances in visible light that is a little over a kilometre.

A body much larger than that casts a shadow of its own size with fringed edges. A body much smaller than that does not cast a shadow of its own size; it casts a diffraction pattern about a Fresnel zone across, shallower than a full obscuration but no narrower.

The consequences run in both directions.

Against the survey: the events are shallow. A half-kilometre body dims the star by a fraction rather than blocking it, so the detection threshold is a photometric one rather than a geometric one, and a marginal event is hard to distinguish from noise.

For the survey: the events are not shorter. The duration is the shadow’s width divided by the relative speed — an interval of time is a length once something is known to be moving — and the width has a floor, so an event by a sub-kilometre body lasts about the same fraction of a second as an event by a kilometre one. A survey does not have to sample faster to reach smaller bodies, which it would if the shadow shrank with the caster.

What a rate measures

The measurement is not a detection. A single serendipitous event is by construction unrepeatable and uncheckable: the body will not be found again, its orbit will not be determined, and nothing about it can be confirmed by any other means.

What is measured is a rate — events per star per hour — and what a rate carries is an integral over the population:

rate    n(a)2 ⁣(a+F)vda,\text{rate} \;\propto\; \int n(a)\,2\!\left(a + F\right)v\,da,

with n(a)n(a) the number density per unit size, FF the Fresnel scale, and vv the relative speed. The observable is that integral, evaluated above whatever size the survey can detect.

So a survey with a lower detection threshold measures a larger rate, and the ratio between two surveys with different thresholds is the slope of the size distribution over the interval between them. That is the quantity the whole exercise exists to get.

The size distribution is what a collisional history predicts, and it is the one prediction of collision theory that can be tested at kilometre scales in the outer solar system. Larger bodies are catalogued by imaging and their distribution is measured directly; below a few tens of kilometres nothing else reaches.

Below 0.4 km a shadow stops getting smaller. The relative rate at which a star is occulted, against the smallest body a survey can detect, for size distributions with slopes 3.5, 4, 4.5. The cross-section of a body is not its own diameter: diffraction gives every shadow a minimum width of about the Fresnel scale, √(λD/2), which at 3 AU and 550 nm is 0.35 km. Above that the cross-section grows with the body, so lowering the limit gains events as the limit to the power -1.5 for the shallowest distribution drawn; below it the cross-section stops shrinking and only the number of bodies keeps rising, which is a shallower gain by one power. Pushing the limit from 20 km to 0.05 multiplies the rate by 19041027 at the steepest slope and 42005 at the shallowest — so the rate a survey measures is a measurement of the size distribution, which is the quantity a collisional history predicts and nothing else can reach at these sizes.
Fig. 2 The same calculation for the main asteroid belt at three astronomical units, where the Fresnel scale is 0.35 kilometres rather than 1.3. The floor moves down with the square root of the distance, so a nearer population can be probed to smaller bodies — and the events are shorter, because the same shadow width crosses at a higher relative speed. The technique is easiest where the bodies are already catalogued and hardest where they are not, which is the usual arrangement.

The prediction a cascade makes

The reason a size distribution is worth this much effort is that it is the fossil of a collisional history, and the theory makes a sharp prediction.

A population in collisional equilibrium — where every size is being destroyed by collisions with smaller bodies as fast as it is being resupplied by the fragmentation of larger ones — settles into a power law. For bodies whose strength is independent of size the exponent is 3.5, a result of Dohnanyi’s from 1969 that follows from the self-similarity of the cascade rather than from any detail of the collisions.

Real populations depart from it in ways that carry information. Bodies large enough to be held together by their own gravity rather than by material strength are harder to disrupt, so the distribution steepens above that size. Bodies small enough to be removed by radiation forces are depleted, so it turns over at the bottom. And a population that has not had time to reach equilibrium retains the slope it was born with.

For the Kuiper belt the question is whether the sub-kilometre population is in equilibrium at all. The collision rate there is low — the bodies are far apart and moving slowly relative to one another — so the cascade may not have processed the small end over the age of the solar system. A measured slope of 3.5 would say it has; anything else would say it has not, and would be a measurement of the belt’s original size distribution.

That is a statement about what the outer solar system was made from, reached by counting shadows.

What has been found, and what was withdrawn

The history of this technique is a record of marginal detections, and the pattern is worth setting out because it shows what a rate measurement has to survive.

Early searches using ground-based photometry of single stars reported candidate events at rates implying a very large population of small bodies. Most did not survive scrutiny: the events were single-station, at low significance, and the statistical treatment of a search that examines millions of samples for a rare dip is unforgiving.

The problem is a familiar one in a form that is especially severe here. A survey recording a hundred stars at twenty hertz for a hundred hours takes 7×1087\times10^{8} samples. A threshold that admits one false positive per 10810^{8} samples still admits seven, and the expected number of real events may be smaller than that.

Three defences are used and all three are necessary.

Multi-station coincidence. A real occultation is recorded simultaneously at telescopes separated by less than the shadow’s width and not at telescopes outside it. A detector artefact, a cosmic ray, a bird, or a scintillation event is recorded at one station only. This is the strongest test and it is why modern searches use paired telescopes.

The shape. A real event by a body near the Fresnel scale has a specific diffraction profile — a dip flanked by brightenings — set by the wavelength, the distance and the body’s size. Matching that profile is a much stronger requirement than exceeding a threshold, and it is what distinguishes an occultation from an atmospheric scintillation, which has its own characteristic timescale and no fringes.

The ecliptic latitude dependence. Kuiper belt objects are concentrated toward the ecliptic, so a real population produces a rate that falls with latitude. A survey that observes both on and off the ecliptic has an internal control, and any instrumental cause produces the same rate in both.

The searches that apply all three report rates consistent with a population, at the smallest sizes ever probed in the outer solar system, and the numbers remain uncertain by factors of several.

A shadow edge 10.3 metres wide, and a stellar diameter read off how blurred it is. A star disappearing behind the Moon, drawn as intensity against position across the shadow. The horizontal axis is in Fresnel scales of √(λD/2) = 10.3 metres at 550 nm and 3.844e+5 km, which is the only length the problem has; at a limb speed of 0.62 km s⁻¹ one of them takes 16.6 milliseconds to pass, so the whole event is over in a tenth of a second and needs photometry at a kilohertz. The Moon has no atmosphere and its limb is a knife edge, and a knife edge does not cast a shadow with an edge: the intensity at the geometric boundary is 0.250, a quarter rather than a half, and outside it the light overshoots to 1.37 before ringing down. Every one of those numbers is a property of the wave and of nothing else. What the star contributes is the blurring. Each point of the stellar disc casts its own copy of the pattern, displaced by its own position, so the observed trace is the pattern convolved with the star's projected disc — 22.4 metres wide for the 12 milliarcsecond curve, against a 10.3-metre fringe. The contrast falls from 0.28 to 0.04 across the four curves drawn, and inverting that fall is how several hundred stellar diameters were measured with a single telescope, no interferometer, and no resolution at all. The picture cannot show the limitation that ended the technique's dominance: the Moon goes where it goes, so only stars within a few degrees of the ecliptic are ever occulted, and each is occulted at whatever position angle the geometry happens to offer.
Fig. 3 The diffraction pattern a real event has to match, drawn for the case where it is measured routinely — a lunar occultation, where the Fresnel scale is ten metres rather than a kilometre and the shadow crosses in milliseconds. The physics is identical at forty astronomical units with every length scaled by the square root of the distance. The fringes are the signature that separates an occultation from every other cause of a brief dip, and their contrast depends on the star’s angular size: a small hot star gives sharp fringes and a giant washes them out. The pattern is the identification, so target selection matters as much as it does for a predicted event.

The rate, computed from the other direction

There is a consistency check available and it is worth doing, because it shows how few events the technique expects.

Take a survey monitoring stars near the ecliptic. The number density of kilometre-scale bodies implied by extrapolating the catalogued population downward gives a certain optical depth along a line of sight to a background star — the fraction of the sky covered by their shadows. That optical depth is tiny: of order 10910^{-9} or less.

The rate is that optical depth times the rate at which shadows sweep past, which is the shadow width divided by the relative speed of the shadow across the star’s apparent position. For a Kuiper belt object the Earth’s own orbital motion dominates, at about thirty kilometres a second, so a 1.3-kilometre shadow crosses in a twentieth of a second.

Multiplying through gives of order one event per star per thousand hours. A survey monitoring a hundred stars for a hundred hours expects around ten.

Ten expected events against a hundred million samples is the arithmetic that makes the false-positive discipline above mandatory rather than careful.

Below 1.3 km a shadow stops getting smaller. The relative rate at which a star is occulted, against the smallest body a survey can detect, for size distributions with slopes 3, 3.5, 4. The cross-section of a body is not its own diameter: diffraction gives every shadow a minimum width of about the Fresnel scale, √(λD/2), which at 40 AU and 550 nm is 1.28 km. Above that the cross-section grows with the body, so lowering the limit gains events as the limit to the power -1.0 for the shallowest distribution drawn; below it the cross-section stops shrinking and only the number of bodies keeps rising, which is a shallower gain by one power. Pushing the limit from 40 km to 0.2 multiplies the rate by 210283 at the steepest slope and 953 at the shallowest — so the rate a survey measures is a measurement of the size distribution, which is the quantity a collisional history predicts and nothing else can reach at these sizes.
Fig. 4 The same relation with a shallower family of slopes, including the collisional-equilibrium value of 3.5 in the middle. The curves are closer together than in the hero figure, which is the honest statement of how hard the measurement is: distinguishing a slope of 3.5 from 4.0 requires the rate at two thresholds to a factor of about two, and a survey that measures one rate to a factor of three measures nothing about the slope at all.

Why the duration is the diagnostic it cannot quite be

A single event carries one number beyond its depth, and it is the duration. In principle that number locates the body.

The shadow crosses the observer at the relative velocity of the shadow across the line of sight, which for an outer solar system body is dominated by the Earth’s own orbital motion — thirty kilometres a second, modulated by the body’s motion and by the angle between the line of sight and the Earth’s velocity. So the duration is the shadow width divided by a speed that depends on the observing geometry and on the distance.

Both the width and the speed depend on distance, and they do so in opposite directions. The Fresnel scale grows as the square root of the distance; the apparent relative speed falls as the body’s own contribution becomes negligible and the geometry changes. The net dependence is weak — roughly the square root — so a factor of four in distance is a factor of two in duration.

A duration measured to twenty per cent therefore locates a body to a factor of about one and a half in distance, which is enough to separate the Kuiper belt from the asteroid belt and nowhere near enough to separate the classical belt from the scattered disc.

The events are also short enough that the duration is measured across a handful of samples. At twenty hertz a fiftieth-of-a-second event is one sample; at two hundred hertz it is ten. Sampling rate buys distance discrimination, and that is the main argument for the fastest cameras rather than the most sensitive ones.

Where it works better

The obstacles are photometric, so the escapes are photometric, and two of them are in use.

Above the atmosphere. Scintillation is the dominant source of false positives from the ground, and it is an atmospheric effect. A space telescope monitoring a star field at high cadence has no scintillation, and the two events reported from stellar-photometry missions at kilometre scales are the least ambiguous in the subject — obtained, in both cases, from instruments built for something else.

In the occultation of a bright star by a known body. A survey of a different kind watches the star field around a predicted event and catches shadows of the satellites or fragments near the target, which is how several small bodies have been found — and how rings around a Centaur were.

And one escape is proposed and not yet realised: at longer wavelengths the Fresnel scale is larger, so an infrared or radio survey has a bigger cross-section per body and a lower size threshold in the sense that matters for the rate. It also has worse photometric precision, and the trade has not yet come out in favour.

Below 2.6 km a shadow stops getting smaller. The relative rate at which a star is occulted, against the smallest body a survey can detect, for size distributions with slopes 3.5, 4, 4.5. The cross-section of a body is not its own diameter: diffraction gives every shadow a minimum width of about the Fresnel scale, √(λD/2), which at 40 AU and 2200 nm is 2.57 km. Above that the cross-section grows with the body, so lowering the limit gains events as the limit to the power -1.5 for the shallowest distribution drawn; below it the cross-section stops shrinking and only the number of bodies keeps rising, which is a shallower gain by one power. Pushing the limit from 40 km to 0.2 multiplies the rate by 5531298 at the steepest slope and 24857 at the shallowest — so the rate a survey measures is a measurement of the size distribution, which is the quantity a collisional history predicts and nothing else can reach at these sizes.
Fig. 5 The same population probed at 2.2 microns rather than 550 nanometres. The Fresnel scale goes as the square root of the wavelength, so it doubles to 2.6 kilometres and the floor moves right — every body below that now casts the same shadow, and the gain from lowering the detection threshold shrinks correspondingly. The infrared buys cross-section and loses discrimination, which is the whole of why the trade is not obvious: a survey there detects more events and learns less from each about the size of what made it.

What the catalogued population already says

The small end is what this technique reaches; the large end is measured by imaging, and the two have to join up.

Deep imaging surveys of the ecliptic have catalogued several thousand trans-Neptunian objects, each one an orbit fitted from a short arc of angles and the luminosity function they trace is well measured down to about magnitude 27, corresponding to bodies of a few tens of kilometres. Over that range the size distribution is steep — a slope well above the collisional-equilibrium value — with a distinct break at around a hundred kilometres, above which it is steeper still.

The break is the interesting feature and it has a natural reading. Bodies above it are the ones that were never destroyed; bodies below it are fragments. If that is right, the break marks the largest size at which collisions have processed the population over the age of the solar system, and it is a measurement of the belt’s collisional history rather than of its formation — the same reading an asteroid family’s age gets from a scatter plot.

An alternative reading makes the break primordial: planetesimals formed at about that size directly, by a streaming instability, and the small bodies below it are indeed fragments while the ones above it are original.

The two readings make different predictions about the slope below a kilometre, which is exactly where the imaging stops and the shadows begin. The occultation surveys are aimed at the one interval that distinguishes two accounts of where planetesimals came from, and that is why a technique yielding two confirmed events in two decades is still worth building instruments for.

Where the picture stops

A rate is a product and the factors are not separable. The measured rate depends on the number density, the size distribution, the distance and the relative speed. A survey that detects events cannot tell whether they came from bodies at forty astronomical units or from a nearer, sparser population — the durations differ, but only by the square root of the distance, and a marginal event has a poorly measured duration.

The Fresnel scale assumes a point source and monochromatic light. A real observation is over a band, and a broad band washes out the fringes because each wavelength has its own pattern. That reduces the contrast and therefore the detectability, and the effective Fresnel scale for a broadband observation is not the monochromatic one.

And the shadow speed is the Earth’s, not the body’s. Which means the technique’s sensitivity depends on the time of year and the direction of observation, since the component of the Earth’s velocity across the line of sight varies through the year and vanishes twice.

7 clocks, and a body 233 kilometres across. A stellar occultation reduced. Each horizontal segment is one observer's chord: the star vanished, the star came back, and the interval multiplied by the shadow's 8 km/s across the ground is the length drawn. The longest, at an offset of -28 km, is 252.3 kilometres. The dashed ellipse is the limb fitted to the chords by least squares in the half-length squared, and its equivalent-area diameter is 233.9 km against the silhouette's true 232.9 — the residual is the shape the fitted ellipse cannot hold, not an error in any timing. The two open marks are observers inside the predicted path who saw nothing, and they are measurements: they bound the limb inside their own offsets, which is what fixes the extent when the positive chords all fall on one side. At 0.12 s per contact the length precision is 1.0 km, 0.41 per cent of the body — a size measured with a clock rather than with an angle, on an object no telescope resolves.
Fig. 6 The measurement the same apparatus does when an event can be predicted. Chords across a body from several stations, giving a silhouette — this is what a kilometre-scale body would deliver if anybody knew where it was. The serendipitous survey gives up all of that: no shape, no size for an individual object, no orbit, no second look. What it gets in exchange is access to a population three orders of magnitude below what any catalogue reaches.

The habit, and where else it applies

The structure here is one worth naming because it recurs wherever individual objects are beyond reach.

When no single detection can be confirmed, the confirmable quantity is a rate, and the design problem becomes controlling the false-positive rate rather than characterising an event. Everything about the survey — the multi-station requirement, the profile matching, the latitude control — is aimed at the denominator rather than at the numerator.

The same shape governs the microlensing surveys, where an event is also unrepeatable and the science is in the statistics of many; it governs gravitational-wave searches before the loudest events arrived; and it governs every search for a rare transient against a large background.

What distinguishes the good instances from the bad is whether the survey has an internal control — some direction, time or configuration in which the real signal must be absent and the instrumental one must not. A search with no null direction is a search that cannot report a rate, only an upper limit, and the difference between those two outcomes is a design decision made long before any data are taken.

Still open: how many there are

The measured rates are consistent with a population and are not yet a measurement of one.

The published constraints at the sub-kilometre end differ by an order of magnitude between surveys, and the two space-based detections are two events. The slope over the interval from a hundred metres to a few kilometres — the quantity that would say whether the belt’s small bodies are collisionally processed — is unconstrained.

What would settle it is a survey with enough simultaneous stations and enough hours to accumulate tens of unambiguous events at two different thresholds. That is an instrument rather than an observation, and several have been proposed: arrays of small telescopes monitoring thousands of stars, with the coincidence requirement built into the design rather than assembled afterwards.

The obstacle is not the telescopes, which are cheap. It is that the data rate from a thousand stars at twenty hertz is large and the events are rare enough that nothing can be thrown away until it has been examined, so the analysis is the instrument.

About the same objects

Not linked from either essay — found by the objects both name.

The objects this essay names

Each one links to every other essay that touches it.

Collisional cascadeDetection thresholdDiffractionEvent rateFalse-positiveThe Fresnel scaleHigh speed photometryKuiper beltSerendipitous occultationSize distribution