Amazon develops Nvidia GPU cooling device to meet AI needs

HẠO THIÊN (THEO CNBC) |

According to CNBC, Amazon Web Services (AWS) is developing specialized cooling hardware for next-generation Nvidia GPUs.

Amazon dang phat trien thiet bi lam mat GPU Nvidia de dap ung nhu cau AI. Do hoa: Hao Thien
Amazon is developing Nvidia GPU cooling devices to meet AI needs. Graphics: Hao Thien

Nvidia's GPUs are the main foundation for AI workloads, so they consume a large amount of electricity, requiring a more efficient cooling system. Amazon said it has designed a new solution called the In-Row Heat Exchanger ( IRHX), which can be integrated into both current and future data centers without the need for system overhaul.

Current liquid cooling solutions take up too much space and use too many states, which is not suitable for our scale, said Dave Brown, VP of computing and machine learning at coaches.

Previously, air cooling systems were enough to power older Nvidia GPUs. But with a new generation like the Nvidia GB200 NVL72 - integrating up to 72 GPUs in a single host, Amazon is forced to upgrade its infrastructure.

AWS has launched a new P6e server line, using Nvidia's Blackwell design, providing huge computing power to train and operate large AI models. Before Amazon, GB200 NVL72-based systems were provided through Microsoft and CoreWeave.

As the world's largest cloud provider, Amazon has long been self-developing hardware such as AI chips, servers and network routes to reduce dependence on third parties and increase profits. AWS is now a major contributor to Amazon's net profit, with its highest profit margin since 2014 in the first quarter of 2025.

According to CNBC, Microsoft ( AWS's biggest rival) is also developing its own AI hardware. In 2024, Microsoft also introduced a sidekicks cooling system for the Maia chip designed by the company.

HẠO THIÊN (THEO CNBC)
TIN LIÊN QUAN

Interesting things to know about the wedding of billionaire Amazon Jeff Bezos

|

The wedding of Jeff Bezos (61 year old, Amazon founder) and Lauren Sanchez (55 years old, journalist) will take place over 3 days in Venice with a series of A-list guests.

The reason why the Amazon filed a lawsuit against the New York Times

|

A group in the Amazon is suing major US media outlets, including the New York Times, after being accused of being addicted to pornography.

Amazon launches new AI technology with natural voice

|

Amazon has just launched new artificial intelligence (AI) technology with natural voice and the ability to create smoother videos.

Close-up of an abandoned dormitory about to be converted into public housing in Ninh Binh

|

Ninh Binh - After the merger, to avoid waste, the concentrated student dormitory in Ninh Binh was converted into a public housing area to serve cadres, civil servants...

Football prediction PSG vs Chelsea in the FIFA Club World Cup 2025 final

|

In Sports Perspective No. 223, commentator Quang Tung commented on the FIFA Club World Cup final between PSG and Chelsea.

Shocking statement about Germany's ability to make nuclear weapons

|

Germany has enough capacity and materials to develop nuclear weapons in just a few months if it wants to.

A plane carrying 300 people urgently landed on a strange island, stranded in the middle of the ocean

|

The US plane carrying nearly 300 people made an emergency landing in the middle of the ocean, stranded for more than 31 hours on a strange island.

Interesting things to know about the wedding of billionaire Amazon Jeff Bezos

Chí Long |

The wedding of Jeff Bezos (61 year old, Amazon founder) and Lauren Sanchez (55 years old, journalist) will take place over 3 days in Venice with a series of A-list guests.

The reason why the Amazon filed a lawsuit against the New York Times

Anh Vũ |

A group in the Amazon is suing major US media outlets, including the New York Times, after being accused of being addicted to pornography.

Amazon launches new AI technology with natural voice

QUANG MINH (THEO the verge) |

Amazon has just launched new artificial intelligence (AI) technology with natural voice and the ability to create smoother videos.