Amazon Web Services builds heat exchanger to cool Nvidia GPUs for AI
AI letters, which mean “artificial intelligence”, stand at the Amaz Web Services booth at Hannover Messe Industrial Trade Fair in Hannover, Germany on March 31, 2025.
Julian Stratenschultte | Picture Alliance | Getty Images
Amazon On Wednesday, he said that the cloud section developed hardware to cool new generations Nvidia Graphic processing units used for artificial intelligence workloads.
GPUs strengthen Nvidia’s productive AI explosion require a large amount of energy. This means that companies using processors need additional equipment to cool them.
Amazon thought of erecting data centers that could host common liquid cooling to the best use of this power -open NVIDIA GPUs. However, this process would last very long, and the Compute and Machine Learn Services Vice President Dave Brown in Amazon Web Services were useless. A video He was sent to Youtube.
“They will receive too many data center floor areas or significantly increase the use of water.” Brown said Brown. He said. “And some of these solutions could not work for lower volumes in other providers, but they would not have enough liquid cooling capacity to support our scale.”
On the contrary, Amazon engineers designed the existing and new data exchanger or IRHX, which can be installed in new data centers. For the previous generation Nvidia chips, more traditional air cooling was sufficient.
Customers can now access the AWS service as examples of information processing under the name P6E. Blog post. New systems accompany Nvidia’s design for intense information processing power. NVIDIA’s GB200 NVL72 is packaged together with a 72 NVIDIA Blackwell GPU -bound shelf to train and operate large AI models.
Information process sets based on NVIDIA’s GB200 NVL72 Microsoft or Sunflower seed. AWS is the world’s largest cloud infrastructure supplier.
Amazon presented its own infrastructure hardware in the past. The company has special chips for general purpose information and AI and designs its own storage servers and network routers. While conducting HomeGrown hardware, Amazon is less dependent on third -party suppliers who can benefit the profitability of the company. In the first quarter, AWS has at least the largest operating margin since 2014, and the unit is responsible for most of the net income of Amazon.
Microsoft, the second largest cloud provider, followed Amazon’s leadership and took steps in development of chip. In 2023, the company designed its own systems called Sidekicks to cool Maia AI chips.
WRISTWATCH: AWS announced the latest CPU chip, will offer record network speed
