Crystallography & Symmetry
patterns derived from their groups
Concept

Phase problem — where it appears

That a detector records how much radiation arrives and not when, so half of every diffraction measurement is lost before it is written down. The half that is lost turns out to be the half that carries the structure, which is why a map made from intensities alone shows vectors and not atoms.

Named by 25 essays across one field — each of them below, with the objects they name alongside it.

A lattice and its reciprocal. The reciprocal lattice is where a crystal scatters. A long axis in the crystal gives closely spaced spots and a short one gives widely spaced spots, so the diffraction pattern is the structure turned inside out.

The reciprocal lattice

Nobody has seen a space group. Crystals are read from where they scatter, and where they scatter is a second lattice in which long has become short and short has become long.

diffraction · Diffraction The phase problem. The same structure rebuilt from its diffraction three ways: with the true amplitudes and phases, with the phases scrambled, and with the amplitudes discarded but the phases kept. The atoms survive the loss of the amplitudes and do not survive the loss of the phases, which is what an experiment throws away.

The phase problem

A detector records how much light arrives and not when it arrives, so half of every diffraction measurement is thrown away before it is written down. The half that is lost turns out to be the half that carries the structure.

diffraction · Diffraction A structure, and the vectors between its atoms. On the left, 4 atoms in a cell. On the right, every one of the 16 vectors between them, each drawn from a common origin: 13 distinct positions, with the 4-fold peak at the origin being each atom paired with itself. That right-hand picture is what a Patterson map shows, and it is the thing a diffraction experiment gives without phases. It has more peaks than the structure has atoms — n² against n — which is why interpreting one is hard, and why it is always symmetric about its centre.

The map that needs no phases

A diffraction experiment measures intensities and loses phases, so the electron density cannot be computed from it. One map can be: the transform of the intensities, whose peaks are not atoms but the vectors between them — every ordered pair, brought to a common origin.

diffraction · The Patterson function Every vector between every pair of atoms. The Patterson map of a four-atom structure: the transform of the intensities with every phase set to zero, so it is computable from a measurement and nothing else. Its peaks are not atoms but the vectors between them, and the ringed one is the strongest that is not the origin — taken here as an interatomic vector exactly as a crystallographer takes the vector between two heavy atoms. That it really is one of the structure's own vectors is checked rather than assumed: it lands within 0.0031 of a cell of a difference of two positions, and it sits 0.67 of a cell from the origin, well outside the skirt of the tall peak there. A candidate taken too close to the origin is the same peak seen again and the whole method fails quietly.

Solving from the vector set

A Patterson map contains a copy of the structure laid over every atom in turn. Shift it by one interatomic vector, take the pointwise minimum with itself, and the copies that fail to coincide are cut away — leaving the structure, together with its inverse, from a measurement that carries no phases at all.

diffraction · The Patterson function Two candidates, and the sign that chooses. The phase of reflection (2, 3), recovered from three measurements and no model. The circle is every complex number of the measured amplitude; the isomorphous difference fixes the cosine of the angle between the unknown phase and the heavy atom's, leaving the two candidates marked; the anomalous difference fixes the sine, which picks one. The recovered phase agrees with the true one to fifteen decimal places, and the true phase was never used in the calculation.

One experiment gives the cosine, the other gives the sine

Friedel's law holding exactly is what makes the phase unreachable. Its breaking is what hands it back: an isomorphous difference fixes the cosine of the phase and leaves two candidates, and the anomalous difference fixes the sine, which chooses.

diffraction · Friedel's law Two structures on 8 sites with the same vectors. Two arrangements of 4 atoms on a ring of 8 positions. They are not the same arrangement — no rotation of the ring and no reflection carries one onto the other — and every interatomic vector occurs the same number of times in both. The bars below are the shared vector counts, which is the Patterson function of each: the tall one at the origin is the atom count and carries no information, and everything else is what a diffraction experiment measures. Their diffraction patterns are identical in every intensity, so no measurement of intensities, at any resolution, distinguishes them.

Two structures, one Patterson

Eight arrangements of four atoms on a ring of eight sites, and only seven distinct sets of interatomic vectors between them. Two of the arrangements are genuinely different and no measurement of intensities can tell them apart — at any resolution, for ever.

diffraction · Homometry Where a homometric pair comes from. A set that factors as a sumset gives its own partner. If every point of A is a sum b + c with b in B and c in C, and every sum arises once, then reversing C produces a different set with the same vectors — because reversing a factor and reversing its conjugate cancel in the product that the vector set is. Both factors must be asymmetric, which is the constraint that decides where the construction can be used: a two-point set is its own reflection up to a translation, so the smallest useful factorisation is three points by three points, and the smallest structure it builds has nine atoms.

Where the pairs come from

A structure whose atoms are the sums of two smaller sets has a partner: reverse one factor and the interatomic vectors do not notice. The construction is Patterson's own, it explains why homometry exists, and the smallest structure it can build has nine atoms for a reason worth following.

diffraction · Homometry pmg: 80 of 80 restricted. The reflections of pmg inside a window of ±4, with the ones whose phase symmetry restricts to two values picked out. Every solid spot has a structure factor that must be real up to a fixed rotation — a sign, in effect — whatever the atoms turn out to be, and the pale ones have a phase symmetry says nothing about. The 4 palest spots carry two incompatible restrictions at once, which leaves them nothing to be but zero. Which spots these are was computed from the operations, before any structure existed.

The zones that behave as if there were a centre

The phase problem is usually stated as though symmetry had nothing to say about phases. It is true of most reflections and false of some, and which is decidable from the group alone: where an operation carries a reflection onto its own negative, the phase is confined to two values half a turn apart, computed from that operation's translation.

diffraction · Statistics ⟨cos Φ⟩ against κ, 379 triplets. The mean cosine of the triplet, binned by the concentration κ = 2|E₁E₂E₃|/√N, for the 379 triplets of a structure of 24 atoms whose reflections all exceed |E| = 1.2. The curve is Cochran's I₁(κ)/I₀(κ), computed from the distribution and not fitted to anything; the points are measured, with the number of triplets in each bin printed above. They agree to 0.1 root-mean-square. The measured points sit slightly above the curve throughout, which is the finite structure showing: Cochran's derivation assumes atoms placed at random and there are only 24 of them.

Three phases that do not move when the origin does

A phase is a property of the description, not of the crystal: shift the origin and every one of them changes. A sum of three phases whose indices add to zero does not change, because the shifts cancel. That sum is the smallest thing about a structure that a diffraction experiment could in principle know, and it is not distributed at random.

diffraction · Direct methods A map from amplitudes alone, 0.59 grid steps out. The density after 150 cycles of flipping, with the atoms that produced the data drawn as rings — moved into the origin and the handedness the solution chose, because a phase set does not fix either and comparing without allowing for them measures the arbitrariness of the description. Every peak of the map is an atom and every atom has a peak. Nothing about the arrangement went into the calculation: the input was a list of amplitudes and a random set of phases.

The solver that knows no symmetry

Compute a map from amplitudes and random phases, reverse the sign of everything below a small threshold, transform back and keep the phases. Repeat. The structure appears — and so does its space group, which was never supplied.

diffraction · Direct methods Two kinds of atom, and more ambiguity rather than less. Exhaustive searches on rings of four sizes. The third column counts homometric groups when every atom is identical; the fourth counts them when each atom may be one of two kinds. The fourth is larger at every size, and at nine and ten sites the third is nothing at all — there is no pair of arrangements of four identical atoms that a diffraction experiment cannot separate, and there are six and four once the atoms may differ. Distinguishing the atoms adds information to the structure and adds ambiguity to the measurement.

When the atoms are not all the same

Every homometric pair found so far is a pair of point sets, where an atom is a point and counts once. Give the atoms different scattering powers and the ambiguity does not go away — it grows. On a ring of nine there is no pair of four identical atoms that diffraction cannot separate, and there are six once two kinds of atom are allowed.

diffraction · Homometry The same structure, mapped from intensities and from differences. Left, the ordinary Patterson map of the structure: 14762 interatomic vectors, a continuous field of overlapping peaks, and the two vectors between the anomalous scatterers — circled — nowhere among its strongest. Right, the map from squared Bijvoet differences over the same reflections: two peaks after the origin, and they are those two vectors. The difference map is 7381 times smaller a problem to read.

A map of the atoms that break the law

Feed a Patterson synthesis the differences between the two halves of each Friedel pair instead of the intensities, and the map that comes back holds the vectors between the anomalous scatterers and nothing else. Two atoms among a hundred and twenty-two: 14,762 vectors become two.

diffraction · The Patterson function The sign turns when the cross terms go weak. Every quartet among the strong reflections of a small structure, sorted by the mean of its three cross terms, with the mean cosine of the phase sum in each bin. Where the cross terms are strong the quartet behaves like a triplet and the cosine is near one. Where they are weakest it is -0.698 — negative — and 93 per cent of those quartets have a cosine below nought. The four reflections of the quartet are equally strong in every bin; what changes is three reflections that are not in the sum at all.

The relation that can say no

Every phase relation before this one pushes a sum towards zero, so none of them can contradict another — a phase set satisfying all of them badly is still satisfying them in the same direction. A quartet can be estimated at π instead, and it is when its three cross terms are weak, so the information arrives from the reflections nobody would have thought worth measuring.

diffraction · Direct methods An equality, with a known factor in it. Sayre's identity says the structure factor is proportional to the convolution of the structure factors with themselves — an equality, not a probability — with a factor that depends on the atoms and the resolution and on nothing else. Computed for a structure of Gaussian atoms, the ratio of the two sides falls with resolution exactly as predicted: the logarithm of the ratio is a straight line in the squared index, its slope is minus half the width in the atomic factor, and the ratio is very nearly real and positive, so the identity relates the phases and not only the amplitudes.

The relation that is an equality

Every relation of this kind so far is a probability — right nine times in ten, useless applied once and decisive applied ten thousand times. One is not. For a structure of equal, resolved atoms the squared density has peaks in the same places, so every structure factor is exactly a convolution of all the others, with a factor that depends only on the atom. It is exact, and on its own it is useless.

diffraction · Direct methods Heavier atoms spoil the line, and then mend it. Above, the scatter of Sayre's ratio about its fitted line, averaged over four random cells, as a quarter of the atoms is made heavier, for cells of eight and of twelve atoms. Below, one minus the square of ρ, the correlation between the density's transform and its square's, computed from the composition alone. The spread of atomic numbers grows without limit along this axis, but ρ does not keep falling: it is lowest near a weight of three and climbs back towards one as the heavy atoms come to dominate, because a cell ruled by a few equal heavy atoms is nearly a cell of equal atoms. The scatter rises and falls with it. At equal weight what scatter remains comes from atoms that overlap, more of them in the larger cell.

Unequal atoms break the equality, and very unequal ones mend it

Sayre's identity is exact for a cell of equal atoms. Give a quarter of them more weight and the line it predicts scatters, reflection by reflection, by exactly the difference between weighting atoms by Z and by Z squared. Make them heavier still and the scatter shrinks again, because a cell ruled by a few heavy atoms is nearly a cell of equal ones. The scatter measures the cell, but only if the phases are already known.

diffraction · Direct methods Which cells the flipping solver finds. For four cells of twenty atoms — all carbon, a quarter sulphur, one sulphur, one lead — the share of random starting phase sets that charge flipping takes to the right structure within 250 cycles, against the threshold below which density has its sign reversed. Each point pools several random arrangements of atoms with several starts each, and the atoms fall off with angle as real atoms do. The cells with sulphur are solved more often than carbon alone, the quarter-sulphur cell most of all, each at a threshold near one standard deviation; the lead cell is never solved at any threshold.

The heavy atom the flipping solver cannot see past

Sayre's identity degrades as a cell's atoms become unequal, most of all for a quarter of heavy atoms three times the weight of the rest, and the obvious prediction is that a solver built on the same sparseness should struggle there too. It does not. Charge flipping solves a cell of carbon with sulphur in it more often than carbon alone, and never solves a cell with one lead atom — because a threshold stated in standard deviations belongs to whichever atom owns the map's variance.

diffraction · Direct methods The worst edge pair is the two most anomalous wavelengths. For each pair of the four wavelengths, and for the peak, inflection and high remote together, the median error of the phase difference between the whole structure and its anomalous atoms, recovered from both Friedel mates at each wavelength with a 1% error on every intensity. Beside each, the spread of f′ across the chosen wavelengths. The pairs that include a remote wavelength and one on the edge phase to seven or eight degrees; the peak and the inflection together, the two with the largest anomalous effect, to eighteen; the two remotes to fifty-five.

The two most anomalous wavelengths are the wrong pair

A MAD experiment measures both Friedel mates at two wavelengths near an absorption edge and solves for a phase. The obvious choice is the two wavelengths where the anomalous effects are largest, the peak of f″ and the dip of f′. Of all the pairs that use the edge, it is the worst. The sine of the phase is carried by f″, but the cosine is carried by how much f′ changes between the two wavelengths, and two points on the same edge barely change it.

diffraction · Friedel's law Three difference maps of one substructure, and the map they approximate. Patterson syntheses over 1,681 reflections of a structure with 120 light atoms and two anomalous scatterers, from squared Bijvoet differences at one wavelength, squared dispersive differences between two wavelengths, and the two normalised and summed; the fourth panel is the Patterson of the anomalous atoms' own intensities. Circles mark the two vectors between the anomalous atoms. Each map's correlation with the exact one is printed beneath it: Bijvoet 0.775, dispersive 0.838, combined 0.999.

A second wavelength completes the map

The Bijvoet difference carries the anomalous substructure's intensity times the sine squared of a phase; the dispersive difference between two wavelengths carries it times the cosine squared. Normalised and added, the two make the substructure's own Patterson, correlation 0.999. It needs no fewer reflections than either half, because the threshold was never the average. What the dispersive half brings is a way of failing the Bijvoet half cannot have: two datasets, and a scale between them.

diffraction · The Patterson function Almost no homometric pair on the torus is a reversed factor. For ten plane groups at several numbers of atoms on a 6 × 6 torus, the structures, the pairs of structures sharing one Patterson, how many of those pairs reversing one factor of a sumset explains, and how many are a patchwork of Galois classes. Factor reversal explains 2 of 3522; the patchwork explains all 3522.

A homometric twin is the structure moved class by class

On a ring, every homometric pair a small search found came from one construction: factor the structure as a sumset and reverse one factor. Imposing a plane group on a torus made homometry more common, and the obvious guess was that symmetry makes structures easier to factor. Tested pair by pair, factor reversal explains two of 3,522 homometric pairs on a 6 × 6 torus, and none at all at six atoms. What explains all 3,522 is a different mechanism: the partner is the structure's own Fourier transform moved independently on each Galois class of characters, by a shift, a sign or an inversion.

diffraction · Homometry Where the third wavelength should go. The median Cramér–Rao bound on the phase difference for two hundred reflections, measured at the inflection and the high remote and at a third wavelength whose energy runs across the edge, twice: with f′ known everywhere, and with f′ at the edge energies refined from the data. Known, the best third sits 1 eV above the edge at 6.26°, and a repeat of either wavelength is nearly as good. Refined, both repeats determine nothing, and the best third moves to +2 eV at 6.30°.

The third wavelength is there to measure the edge

A three-wavelength MAD experiment is usually justified as more anomalous signal: a third look at the edge, placed where the first two left the most out. Counted with the scattering factors known, a third wavelength buys nothing a longer look at the best pair would not buy better. Its real job appears only when f′ at the edge has to be found from the data, which it always does. Two wavelengths then carry one equation too few, and any third energy that is not a repeat supplies it, for two hundredths of a degree.

diffraction · Friedel's law Success of the flipping solver against how far off the subtracted lead is. The share of forty starts on the cell of nineteen carbons and one lead that the flipping solver solves, with the lead's density subtracted at a position displaced from the true one by up to sixteen grid steps, half the cell. The rate does not fall with the offset: the points scatter without a trend about the pooled rate of 40%, the band marking two binomial standard deviations, and the original solver, with nothing subtracted, solves none. Refining the position from the map does no better than holding it.

The lead is wherever it is taken out

Charge flipping solves a cell of nineteen carbons and one lead once the lead's own density is taken out before each flip and put back after. The obvious worry was precision: a lead subtracted a fraction of a grid step from where it really is leaves a residual larger than any carbon. The residual is there, larger than a carbon at a tenth of a step. It does not matter. Subtracted two steps away, or half the cell away, the lead still lets the solver succeed at the same rate, because the solver builds the whole structure round wherever it is put.

diffraction · Direct methods A scale error between two wavelengths has a sign. The contrast of the substructure's vectors in a dispersive difference Patterson, the weaker of its two peaks over the strongest other peak, as the second dataset is scaled wrongly, with no metal atom and with two metal atoms that do not scatter anomalously. An error that weakens the second dataset loses the map at 3.7% with no metal; one that strengthens it at 50%. The dashed line is where the substructure's peak is predicted to reach zero, a quarter of the fractional change in f′ between the wavelengths. The metals shorten the strong side and hardly move the weak one.

A scale error between two wavelengths has a sign

A dispersive difference compares two datasets, so a wrong scale factor between them adds the whole structure to it. On a structure whose own Patterson is a haze, the substructure's vectors survived a scale error of fifty per cent, and heavy atoms that do not scatter anomalously were expected to take over much sooner. They do, but only in one direction. Scale the second dataset the other way and the substructure is erased at four per cent whatever else is in the crystal, because the error's linear term cancels the signal. Scaling the datasets onto each other is itself an error of that sign.

diffraction · The Patterson function No triple of wavelengths is best for both the phase and the edge. Every triple of energies on a grid across a model selenium edge, placed by two Cramér–Rao bounds with the edge's position and white line refined from the data: the median phase error across, and the error in the edge's position up, on a logarithmic scale. The front of triples that no other beats on both runs from +1, +2, +150 eV (6.15°, ±0.066 eV) to -120, -1, +3 eV (7.54°, ±0.022 eV). The classic peak, inflection and high remote sits on it, at 6.42° and ±0.026 eV.

The wavelengths that phase best do not find the edge

A MAD experiment refines the anomalous atom's scattering factors so that it can solve for the phases, and those same factors report where the absorption edge sits and how tall its white line stands, which is chemistry. Scored for the edge instead of the phase, the best triple of wavelengths moves: two straddling the step and one far below it, where the phase-best triple put two on the step and one far above. No triple is best at both, and the textbook peak, inflection and remote turns out to be the compromise between them.

diffraction · Friedel's law Four flipping rules on four cells. The best success rate of the flipping solver, pooled over five arrangements and eight starts, on four cells: twenty carbons, a quarter sulphur, one sulphur among twenty and one lead among twenty. Four rules for what is flipped: below a number of standard deviations of the map, below a height set by the lightest atom's weight, the same height above the map's mean, and the original rule with the known heavy atom's density removed first. On the lead cell only the last solves anything, 55% against nothing; on both sulphur cells it raises the rate to near certainty; on carbon alone it is the original rule.

The lead taken out solves what no threshold could

Charge flipping never solved a cell of nineteen carbons and one lead, and two repairs were proposed: a threshold set by the composition rather than by the map's spread, and the lead's own density removed before each flip. The threshold does nothing for the lead cell at any setting, measured from zero or from the map's mean. Removing the lead takes it from nought to fifty-five per cent, and lifts both cells with sulphur in them to near certainty. The trouble was never where the threshold sat.

diffraction · Direct methods Success of the flipping solver against the error in the vector between two subtracted leads. The share of 80 starts on a cell of eighteen carbons and two leads that the flipping solver solves, with both leads' density subtracted, the first at its true place and the second displaced from its true place by an error in a random direction. The rate holds to a quarter of a grid step (21, 19, 18, 11, 0, 0, 0 successes at errors of 0, 0.1, 0.25, 0.5, 1, 2, 4 steps), falls by half at half a step, and is zero from one step on. With one lead the place did not matter at all; with two, the vector between them does.

Two leads need their vector to half a step

With one heavy atom in a cell with no symmetry, charge flipping did not care where the atom was subtracted: it rebuilt the structure round whatever place it was given. With two heavy atoms that freedom runs out, as predicted, because no translation can put both under wrong references at once. Subtract one of them a whole grid step from where it belongs and the solver never succeeds. But the tolerance is five times looser than the estimate it was predicted from: up to a quarter of a step the rate does not move, at half a step it halves, and the residual the solver absorbs is three carbons' worth, not one.

diffraction · Direct methods

Named alongside it

The objects these essays reach for when they reach for this one.

Structure factorDirect methodsThe Patterson functionFriedel lawAnomalous scatteringHeavy atomHeavy atom methodElectron densityInteratomic vectorNormalised structure factorAutocorrelationHomometry

All concepts