From lab to market
What it means, and what it does not
Proven: the list’s 27 newcomers are a record low, a CPU-only machine leads it, and on vendors’ own spec sheets the native double precision of AI chips has stalled or fallen. Not yet shown: that the quiet is permanent. Timothy Prickett Morgan of The Next Platform argues that “the stall is more about roadmap timing”, with buyers waiting on the next generation of chips and networking, and he expects the shortfall to be made up over the next few lists.
For anyone buying compute, “how fast?” now needs a second question: fast at which arithmetic? AI capacity is contracted by the megawatt. On 16 November TensorWave said it will supply OpenAI with 457 megawatts over six years. Scientific capability is still scored in 64-bit flops. A megawatt of one is no longer a known quantity of the other.
Three routes to double precision are on offer. Wide-vector CPUs, LineShine’s route, run existing code unchanged and pay in power. Emulation on AI chips is cheap where it fits: in February the Texas Advanced Computing Center said it expected two to three times native speed on its Horizon system, and would submit Linpack results both ways. Science accelerators are due in 2027 and 2028.
For the CTO. Sort your workloads by arithmetic before you buy or rent: which precision, and matrix-shaped or vector-shaped? An “H100-equivalent” measures AI-fast only. Two boards from one chip family can differ thirtyfold in double precision while matching each other at 8 bits. That reading of Nvidia’s table is ours, not Nvidia’s.
Timeline: Vera CPU racks, early 2027 · AMD MI430X, 2027 · next TOP500, mid-2027 · Rubin HPC, 2028.
Field Notes · How to do 64-bit math on 8-bit hardware
1Split. Turn each double-precision matrix into several matrices of small whole numbers: its remainders after dividing by a set of small numbers that share no factors.
2Multiply. Run each small-number product on the fast low-precision tensor cores. The pieces are small enough that nothing is rounded. Use more pieces and you keep more digits.
3Recombine. The Chinese Remainder Theorem rebuilds the one answer that fits every remainder, and the result is turned back into floating point.
Try it. A number leaves 2 when divided by 7, 3 when divided by 11 and 5 when divided by 13. Only one number below 1,001 fits: 135. Three small facts pin down one larger one. The Ozaki scheme does the same with whole matrices.
Glossary
FP64. Double precision: numbers stored in 64 bits, about sixteen significant digits.
HPL. High-Performance Linpack, the dense equation-solving test that ranks the TOP500.
Capability vs capacity. One machine for one huge job, versus many machines for many jobs.
Ozaki scheme. A way to compute high-precision matrix products from many low-precision ones.