The third of Hilbert's list of mathematical problems, presented in 1900, was the first to be solved. The problem is related to the following question: given any two polyhedra of equal volume, is it always possible to cut the first into finitely many polyhedral pieces which can be reassembled to yield the second? Based on earlier writings by Gauss, Hilbert conjectured that this is not always possible. This was confirmed within the year by his student Max Dehn, who proved that the answer in general is "no" by producing a counterexample. The answer for the analogous question about polygons in 2 dimensions is "yes" and had been known for a long time; this is the Wallace–Bolyai–Gerwien theorem. Unknown to Hilbert and Dehn, Hilbert's third problem was also proposed independently by Władysław Kretkowski for a math contest of 1882 by the Academy of Arts and Sciences of Kraków, and was solved by Ludwik Antoni Birkenmajer with a different method than Dehn. Birkenmajer did not publish the result, and the original manuscript containing his solution was rediscovered years later.
Dehn's proof is an instance in which abstract algebra is used to prove an impossibility result in geometry. Other examples are doubling the cube and trisecting the angle. Two polyhedra are called scissors-congruent if the first can be cut into finitely many polyhedral pieces that can be reassembled to yield the second. Any two scissors-congruent polyhedra have the same volume. Hilbert asks about the converse. For every polyhedron P, Dehn defines a value, now known as the Dehn invariant D, with the following property:
If P is cut into two polyhedral pieces P1 and P2 with one plane cut, then D = D + D.
From this it follows
If P is cut into n polyhedral pieces P1,...,Pn, then D = D +... + D
and in particular
If two polyhedra are scissors-congruent, then they have the same Dehn invariant.
He then shows that every cube has Dehn invariant zero while every regular tetrahedron has non-zero Dehn invariant. This settles the matter. A polyhedron's invariant is defined based on the lengths of its edges and the angles between its faces. Note that if a polyhedron is cut into two, some edges are cut into two, and the corresponding contributions to the Dehn invariants should therefore be additive in the edge lengths. Similarly, if a polyhedron is cut along an edge, the corresponding angle is cut into two. However, normally cutting a polyhedron introduces new edges and angles; we need to make sure that the contributions of these cancel out. The two angles introduced will always add up to Pi|; we therefore define our Dehn invariant so that multiples of angles of give a net contribution of zero. All of the above requirements can be met if we define D as an element ofthe tensor product of the real numbersR and the quotient spaceR/ in which all rational multiples of are zero. For the present purposes, it suffices to consider this as a tensor product of Z-modules. However, the more difficult proof of the converse makes use of the vector space structure: Since both of the factors are vector spaces over Q, the tensor product can be taken over Q. Let ℓ be the length of the edge e and θ be the dihedral angle between the two faces meeting at e, measured in radians. The Dehn invariant is then defined as where the sum is taken over all edges e of the polyhedron P. It is a valuation.
Further information
In light of Dehn's theorem above, one might ask "which polyhedra are scissors-congruent"? Sydler showed that two polyhedra are scissors-congruent if and only if they have the same volume and the same Dehn invariant. Børge Jessen later extended Sydler's results to four dimensions. In 1990, Dupont and Sah provided a simpler proof of Sydler's result by reinterpreting it as a theorem about the homology of certain classical groups. Debrunner showed in 1980 that the Dehn invariant of any polyhedron with which all of three-dimensional space can be tiled periodically is zero. Jessen also posed the question of whether the analogue of Jessen's results remained true for spherical geometry and hyperbolic geometry. In these geometries, Dehn's method continues to work, and shows that when two polyhedra are scissors-congruent, their Dehn invariants are equal. However, it remains an open problem whether pairs of polyhedra with the same volume and the same Dehn invariant, in these geometries, are always scissors-congruent.
Original question
Hilbert's original question was more complicated: given any two tetrahedra T1 and T2 with equal base area and equal height, is it always possible to find a finite number of tetrahedra, so that when these tetrahedra are glued in some way to T1 and also glued to T2, the resulting polyhedra are scissors-congruent? Dehn's invariant can be used to yield a negative answer also to this stronger question.