NVIDIA's latest AI infrastructure uses liquid cooling at temperatures hotter than a typical hot tub. The approach eliminates traditional fans and chillers in data centers. It aims to cut energy use, water consumption and noise.
NVIDIA's Rubin generation of AI servers operates with coolant at 45 degrees Celsius, or 113 degrees Fahrenheit. This liquid enters processors at that temperature and exits around 55 degrees after absorbing heat, while keeping chips within safe limits.
The system replaces air-based cooling that once accounted for up to 40 percent of a data center's electricity costs. Raising temperatures by one degree can reduce cooling energy expenses by about 4 percent, according to industry estimates.
Water usage drops sharply under the new design. Conventional systems consume roughly 2.6 million gallons per megawatt per year, but the closed-loop liquid cooling brings that figure close to zero.
Servers also become more compact, fitting into two rack units instead of six. The architecture removes fans and reduces noise, though results depend on local climate conditions.
