Next-generation data center platforms from AMD, Intel, and Nvidia consume between 500W and 1000W of power. This is a slide from Gigabyte’s roadmap published by the famous hardware he leaker. HXL indicates Cooling these CPUs and GPUs in 2024-2025 will require significant effort.
CPUs and GPUs in modern data centers already consume hundreds of watts of power, making their cooling a major challenge for server manufacturers and data center operators. However, there is an intrinsic need for performance in the artificial intelligence (AI) and high-performance computing (HPC) fields, which is driving processor developers to deliver even more powerful chips with higher power consumption over the next few years. said it was planned. to the slide.
Intel and AMD’s next-generation general-purpose processors, scheduled for 2024-2025, are expected to consume between 500W and 600W of power. Bearing in mind that AMD’s socket SP5 is designed to deliver up to 700W of power to CPUs, Gigabyte’s predictions might even seem a bit conservative.
When it comes to data center GPUs, Nvidia’s SXM5 GPU, with a power consumption of around 700W per module, should remain the most power-hungry unit for some time. On the other hand, nothing is said about the power requirements of AMD’s Instinct MI300.
Meanwhile, the consumption of compute GPUs in PCIe card form factors will increase to 400 W to 500 W, the slide shows. Interestingly, AMD itself predicts a GPU that consumes around 700W of his, so Gigabyte’s predictions are in line with AMD’s own predictions.
Perhaps the most interesting part of Gigabyte’s alleged slide is the power consumption of Nvidia’s Grace Hopper superchip, which varies from 600W to 1000W.
It’s amazing how server makers cool processors that consume so much power along with high-power parallel computing devices. However, liquid cooling and possibly immersion cooling are certainly options to consider.
Note that while the information in the slides appears reasonable, the slides themselves are from unofficial sources. Please take this information with a grain of salt, as its authenticity has not been confirmed.
