The singularity that is a change of variable
Assumes Universal variables and The ellipse.
An inverse-square force has a hole in it. At zero separation the acceleration is infinite, the speed is infinite, and every numerical method ever written produces nonsense there. That much is expected of a formula with in a denominator. What is not expected is that the trouble starts a very long way from the hole: an orbit at eccentricity 0.9 never comes closer to its primary than a tenth of its semi-major axis, and a well-behaved integrator taking equal steps of time will still lose the plot on it.
The reason is not the force law. It is the choice of independent variable. Time is a poor coordinate for a Kepler orbit because the body spends most of it doing almost nothing and then does everything in a few per cent of it — and the fix, which is exact and not an approximation, is to stop using time.
What the map actually says
Take the plane as the complex numbers and write the physical position as . Set and, at the same time, replace the time by a new independent variable through
Under those two substitutions together the equation of motion for the inverse-square force becomes
with the total energy. That is Hooke’s law. For a bound orbit and it is a harmonic oscillator of angular frequency ; for a hyperbolic orbit it is the same equation with the sign flipped and the solutions are hyperbolic sines; for the parabola and the motion in is uniform in a straight line. One linear equation covers every conic the force allows, and the branch that the universal formulation removes from the time equation has been removed from the equation of motion as well.
The geometry in the opening figure is why. Squaring doubles angles, so one circuit of the oscillator is one circuit of the orbit; and for tracing a centred ellipse with semi-axes and , the image has semi-axes and about a centre displaced by — and the focal distance works out to that same displacement exactly. The origin is a focus by construction rather than by arrangement.
The step that chooses itself
The second substitution is the one that pays for itself in practice, and it can be understood without any complex arithmetic at all. Since , a fixed step in is a time step proportional to the current radius: short near periapsis, long near apoapsis, and set by nothing but where the body is.
The effect on a drawing is immediate.
That is an adaptive integrator’s behaviour obtained without an adaptive integrator. A step-size controller measures a local error estimate, compares it against a tolerance, accepts or rejects, and adjusts — machinery with parameters in it, and parameters are where a method’s behaviour stops being a theorem. The regularised step needs none of it. The variable itself carries the adaptation, and the same fixed step is right at every point of the orbit because the equation being stepped is a harmonic oscillator, whose solutions are smooth on a scale that does not vary at all.
Where the eccentric anomaly comes from
There is a reward for the change of variable that has nothing to do with numerics, and it explains something that otherwise looks like an accident of history.
For a bound orbit the fictitious time is proportional to the eccentric anomaly — specifically , or more usefully, equal steps of are equal steps of . So the angle that Kepler introduced as a construction on the auxiliary circle, and that everyone since has treated as an intermediate quantity to be got rid of, is the natural time of the regularised problem. That reframing is worth stating plainly because it inverts the usual order of explanation. The eccentric anomaly is not a trick for making Kepler’s equation writable. Kepler’s equation is the price of insisting on the wrong independent variable, and the eccentric anomaly is the right one showing through.
Three dimensions, and why it took until 1965
The plane is easy because the plane is the complex numbers, and squaring is a perfectly good map on them. Space is not so obliging. Squaring in three dimensions has no meaning, and there is no three-dimensional algebra in which it would.
The resolution, found by Kustaanheimo and Stiefel in 1965, is to go up rather than sideways: the physical position in is written as a quadratic function of a point in , using what amounts to quaternion multiplication. The extra dimension is not physical and is fixed by a constraint, and with it the same result holds — the regularised equations of motion in four dimensions are four uncoupled harmonic oscillators, all of the same frequency, with the energy as that frequency.
This is a genuinely surprising place for the Kepler problem to end up. The oldest solved problem in dynamics turns out to be a linear oscillator in disguise, and the disguise is a dimension count. It is the same fact that shows up elsewhere as the hidden symmetry of the inverse square — the conserved vector that keeps a bound orbit from precessing is a consequence of a four-dimensional rotation group acting on exactly this space, and Bertrand’s theorem about which force laws close their orbits is the statement that only two force laws admit a transformation of this kind.
What was actually measured, and where it is used
Nothing in this essay is an observation of the sky, and it would be dishonest to dress it as one. What can be pointed at is where the method earns its keep, and the numbers there are real.
Every modern high-precision solar-system ephemeris integrates regularised or partially regularised equations, and the reason is close encounters. A comet passing Jupiter at a hundredth of an astronomical unit, an asteroid grazing the Earth, a satellite of Saturn passing another — each is a pericentre passage about a body it is not orbiting, and each would eat a fixed-step integrator alive. The same is true of the star-cluster codes that follow a few thousand stars for a few billion years: binaries form, harden and pass through pericentre at separations of a few stellar radii, and it is entirely routine for such a code to spend most of its time on the tightest pair in the system. Regularisation of those pairs — chain regularisation, which applies the same substitution to a whole hierarchy of close bodies at once — is what makes the calculation finish at all.
Sundman, and a series that converges to nothing useful
The transformation has a curious place in the history of the subject, because it was invented for a problem it did not solve.
In 1912 Karl Sundman published a series solution of the three-body problem. That sentence is usually met with disbelief, since the three-body problem is famously the thing that has no solution — and both statements are true, because they mean different things. Sundman produced a power series in , convergent for all real time, giving the positions of three gravitating bodies with the sole exception of the case where the total angular momentum vanishes and a triple collision is possible. The machinery that made it work was regularisation: binary collisions had to be shown to be removable before any series could be continued through them, and Levi-Civita’s transformation, published in its modern form eight years later, is the two-body core of that argument.
The catch is the one every account gives and few make concrete. The series converges, and it converges so slowly that estimates of the number of terms needed for astronomical accuracy run to . It is a solution in the sense a mathematician means and in no sense anybody else means, and its real legacy is the technique rather than the result.
What a cluster code does with a binary
The transformation earns its keep in one particular place, and it is worth describing because it explains why an obscure change of variables is standard equipment.
Simulating a star cluster means integrating thousands of bodies for billions of years. The difficulty is not the number of bodies; it is that a few of them form very tight binaries, whose orbital periods are shorter than the cluster’s dynamical time by many orders of magnitude. An integrator that must resolve a one-day orbit cannot advance a ten-million-year simulation.
Worse, those binaries are where the interesting physics happens. A hard binary is an energy reservoir: it hardens further in three-body encounters and gives up energy to the cluster, which is what halts the core collapse a purely collisional system would otherwise undergo. Removing them is not an option.
Regularisation is how they are kept without paying for them. A tight pair is taken out of the direct summation and integrated in regularised variables, where the motion becomes a harmonic oscillator and the step size no longer has to shrink at pericentre. The pair’s centre of mass remains in the main integration as a single particle, and the internal motion is advanced separately and accurately.
The technique extends to more than two bodies. A hierarchical triple, or a chain of several bodies undergoing a close encounter, is handled by chain regularisation: the bodies are ordered along a chain of relative coordinates, each link regularised, so that the singularities of every close pair are removed at once. That is what allows a cluster simulation to follow a resonant three-body encounter — the ones that eject stars and harden binaries — without either failing or spending the entire computation on it.
The change of variables is therefore not a curiosity about the two-body problem. It is the reason a class of astrophysical simulation is possible at all, and the reason those codes carry a separate module for anything that comes too close.
The same transformation, in a different subject
There is one further destination for the four-dimensional version, and it belongs to a subject that has nothing to do with orbits.
The Kepler problem and the hydrogen atom have the same potential. So the transformation that turns a three-dimensional inverse-square problem into a four-dimensional harmonic oscillator does so in quantum mechanics as well, and the Coulomb problem in three dimensions becomes an oscillator problem in four.
That matters because the oscillator is the one problem everybody can solve. Its spectrum is a ladder of equally spaced levels; mapping that back through the transformation produces the hydrogen atom’s energies, and the mapping explains their degeneracy — the accidental degeneracy of hydrogen’s levels, which looks unexplained in three dimensions, is the ordinary degeneracy of a four-dimensional oscillator.
The classical statement of the same fact is the conserved vector along the major axis, which is why the orbit closes and does not precess. The extra symmetry that keeps a Kepler ellipse from turning and the extra degeneracy in hydrogen’s energy levels are one thing, seen twice, and the change of variables in this essay is the map between the two views.
Where the trick stops working
Regularising a two-body collision succeeds completely, and it is worth asking why the same treatment does not dispose of every singularity in the problem — because the answer is a theorem rather than a shortage of cleverness.
A binary collision is, in the regularised variables, a perfectly ordinary point of the motion: the solution passes through it analytically and continues on the other side, describing a body that falls in, bounces and comes back out along the same line. That is not physics — real bodies do not bounce — but it is a legitimate analytic continuation, and it means the singularity was never in the dynamics, only in the coordinates.
A triple collision is different. Sundman proved that a triple collision can occur only if the total angular momentum of the system is exactly zero, which is a set of measure zero among initial conditions — so in that sense it never happens. But when it does, the singularity is genuine: the solution cannot be continued through it, because the way the three bodies approach one another does not settle down to a single limiting shape. Different sequences of times give different limiting configurations, and there is nothing for the continuation to continue to.
There is a stranger result still. A singularity in the -body problem need not be a collision at all. For five or more bodies there exist solutions in which no two bodies ever touch and yet the motion ceases to be defined after a finite time, because some of the bodies are thrown to infinity in that finite time — driven by an oscillating tight binary that feeds them energy. Such non-collision singularities were conjectured in the nineteenth century and constructed only in 1992.
So the change of variable in this essay is exactly as general as the two-body problem is, and the singularities it cannot remove are the ones that are not artefacts of a coordinate choice. The distinction is the point: a singularity that can be transformed away was never there, and one that cannot be is saying something about the system.
It also explains why the cluster codes of the previous section regularise pairs and chains rather than the whole system at once. There is no transformation that removes every singularity of an -body problem, because some of them are not removable; what the codes do is remove the ones that are, which happen to be the ones that occur.
Which is a fair statement of the whole method’s standing: it is a complete answer to a problem that occurs constantly and a partial answer to the general one, and the boundary between the two is a theorem rather than a matter of effort.
One more orbit shows the map applied where there is no near-singularity to remove.
Where the picture stops
Two honest limitations, and neither is small.
The first is that regularisation removes the singularity of the two-body problem and no other. A body falling into a point mass is fine; three bodies arriving at one place at one instant is a triple collision, and no change of variable removes it, because the problem genuinely is not analytic there. That result is Siegel’s, and it is one of the reasons the three-body problem is unsolvable in the specific sense that word has rather than merely difficult.
The second is that the transformed problem is only linear when the force is exactly inverse-square. Add an oblateness term, a third body, atmospheric drag or a relativistic correction and the equation in acquires a forcing term. It is still enormously better conditioned than the original — the singularity is still gone, and the step is still adaptive for free — but it is no longer a harmonic oscillator, and the exactness that makes the picture beautiful is the first thing a real application loses.
The map and the functions it produces are the two objects the trick consists of, and each is worth reading at a setting more extreme than the ones the essay uses to introduce it.
Where this ladder goes next
The regularised form is a statement about conditioning: the same motion, described in variables that make its difficulty disappear. That is a theme with more rungs on it than this one. The next asks a related question about the elements rather than about the trajectory — the six numbers that fix an orbit include three angles that are undefined for perfectly ordinary orbits, and the cure is the same in kind: not a better solver, but a better set of coordinates.
Further along the same line sit the questions of what a set of variables costs rather than what it hides. An orbit determined from angles alone is badly conditioned for a reason no substitution removes, because the information is genuinely absent rather than merely awkwardly parameterised. Telling those two cases apart — a difficulty that is in the coordinates and a difficulty that is in the data — is most of what numerical celestial mechanics consists of, and the Levi-Civita map is the cleanest example of the first that the subject has.
About the same objects
Not linked from either essay — found by the objects both name.
- Every note turns back at its own depth conditioning · regularisation
What links here
Essays that link to this one from their own argument.
- A step that must not be adapted gravitation
- An error that grows like a random walk gravitation
The objects this essay names
Each one links to every other essay that touches it.
Collision singularityConditioningEccentric anomalyEnergy driftFictitious timeHarmonic oscillatorLevi civita transformationRegularisationStep size controlStumpff functions