GoKawiilIn 2025, data centers consumed 485 TWh of electricity. Thirty percent of that, more than the entire annual power consumption of Sweden, went to cooling. Scientists have developed a 3D-printed copper-plate cooling tech that can slash this figure by over 90%!
The technology combines a mathematical algorithm with 3D printing to create pure copper cooling plates that dramatically outperform conventional cold plates used in direct-to-chip cooling systems. According to the researchers from the University of Illinois Urbana-Champaign, applying the technology across an entire data center could reduce cooling-related electricity consumption from roughly 30% to just 1.1%.
The AI boom has driven data center electricity consumption to staggering levels, to the point that companies are considering building data centers in space to gain more direct access to solar energy! What makes AI’s power demand more striking is that one-third of this power has absolutely nothing to do with computation. It all goes to cooling the hardware. A single NVIDIA GB200 chip runs at 1,200 watts, consuming 28.8 watt-hours of electricity daily. That's roughly equivalent to the average daily consumption of a US household, calculated from the total yearly consumption. One chip. But that's not even our pain point.
Due to a phenomenon known as Joule heating – an unavoidable consequence of how they operate at a fundamental level – chips dissipate almost exactly the amount of power they consume as heat. Therefore that GB200 chip also dissipates 1,200 watts of heat. Over an hour, that’s enough energy to theoretically boil over 50 cups of water. Again, one chip.
Now imagine thousands to hundreds of thousands of these chips stacked in racks, as they are in large AI data centers. Without intervention, xAI’s Colossus 1 data center with its 220,000 GPUs and 300 MW consumption would generate enough heat to raise the temperature of the 785,000-sq-ft space to 1200 °C (2192 ºF) in one hour, hotter than molten lava. This is why cooling is a crucial, non-negotiable aspect of running data centers. Cooling systems require electricity.
“Cooling is the bottleneck in computer-chip design,” says Behnood Bazmi, mechanical engineer and the paper’s first author. “By bridging the gap between computational design and manufacturing capability, our approach provides a pathway for more energy-efficient liquid cooling of chips and other electronics.”
Traditionally, data centers have relied on air cooling to prevent computer chips from overheating. In these systems, metal heat sinks are mounted directly onto CPUs and GPUs, allowing heat to spread out across thin metal fins while powerful fans blow air across them. This method consumes large amounts of electricity because facilities must power several large air-handling units. Additionally, modern AI accelerators are generating heat at levels that conventional air cooling is increasingly struggling to handle efficiently.
As a result, newer systems are shifting toward liquid-based direct-to-chip cooling, in which a metal “cold plate” is mounted directly onto the processor and coolant flows through microscopic internal channels within the plate. Heat from the chip transfers to the metal plate and is then carried away by the circulating liquid far more efficiently than air can.
Conventional cold plates already exist commercially, but their internal fins and fluid channels are typically designed around manufacturing simplicity rather than maximum thermal performance, often using relatively simple rectangular or cylindrical geometries and materials such as aluminum alloys or stainless steel.
The researchers' solution addressed two critical aspects of existing technologies: material and fin design. In a technique known as topology optimization, the researchers used a mathematical optimization algorithm to redesign the tiny internal fin structures from the conventional rectangular or cylindrical geometries into far more complex, jagged, and pointed shapes that maximize heat transfer and thermal performance, while minimizing the pumping effort required to move coolant through the plate.
... continue reading