Amazon develops Nvidia GPU cooling device to meet AI needs

HẠO THIÊN (THEO CNBC) |

According to CNBC, Amazon Web Services (AWS) is developing specialized cooling hardware for next-generation Nvidia GPUs.

Amazon dang phat trien thiet bi lam mat GPU Nvidia de dap ung nhu cau AI. Do hoa: Hao Thien
Amazon is developing Nvidia GPU cooling devices to meet AI needs. Graphics: Hao Thien

Nvidia's GPUs are the main foundation for AI workloads, so they consume a large amount of electricity, requiring a more efficient cooling system. Amazon said it has designed a new solution called the In-Row Heat Exchanger ( IRHX), which can be integrated into both current and future data centers without the need for system overhaul.

Current liquid cooling solutions take up too much space and use too many states, which is not suitable for our scale, said Dave Brown, VP of computing and machine learning at coaches.

Previously, air cooling systems were enough to power older Nvidia GPUs. But with a new generation like the Nvidia GB200 NVL72 - integrating up to 72 GPUs in a single host, Amazon is forced to upgrade its infrastructure.

AWS has launched a new P6e server line, using Nvidia's Blackwell design, providing huge computing power to train and operate large AI models. Before Amazon, GB200 NVL72-based systems were provided through Microsoft and CoreWeave.

As the world's largest cloud provider, Amazon has long been self-developing hardware such as AI chips, servers and network routes to reduce dependence on third parties and increase profits. AWS is now a major contributor to Amazon's net profit, with its highest profit margin since 2014 in the first quarter of 2025.

According to CNBC, Microsoft ( AWS's biggest rival) is also developing its own AI hardware. In 2024, Microsoft also introduced a sidekicks cooling system for the Maia chip designed by the company.

HẠO THIÊN (THEO CNBC)
TIN LIÊN QUAN

Interesting things to know about the wedding of billionaire Amazon Jeff Bezos

|

The wedding of Jeff Bezos (61 year old, Amazon founder) and Lauren Sanchez (55 years old, journalist) will take place over 3 days in Venice with a series of A-list guests.

The reason why the Amazon filed a lawsuit against the New York Times

|

A group in the Amazon is suing major US media outlets, including the New York Times, after being accused of being addicted to pornography.

Amazon launches new AI technology with natural voice

|

Amazon has just launched new artificial intelligence (AI) technology with natural voice and the ability to create smoother videos.

The journey to turn Ponagar Tower into a special national monument

|

Khanh Hoa - The Government has recognized Ponagar Tower as a special national monument.

Research on Vietnamese people playing casino after the pilot period

|

The Deputy Prime Minister requested to study special policies for the development of Phu Quoc Special Zone, allowing Vietnamese people to play casino after the pilot period.

Raising growth forecast for 2025, stocks welcome large cash flow

|

Many securities organizations and companies have increased their forecasts for Vietnam's GDP growth in 2025. The stock market flourished, large-cap stocks led the increase.

Continue to reorganize mass organizations assigned by the Party and the State

|

The Party Committee of the Vietnam Fatherland Front and Central organizations will lead and direct the continued reorganization of mass associations assigned by the Party and State to operate under the Vietnam Fatherland Front, in the direction of reducing the number, streamlining the internal apparatus, and operating practically and effectively.

Buying Vietlott lottery on the day of giving birth, a worker won more than 16 billion VND

|

A man has just received the Vietlott Jackpot 2 lottery draw Power 6/55 QSMT No. 01210 with a value of more than 16 billion VND.

Interesting things to know about the wedding of billionaire Amazon Jeff Bezos

Chí Long |

The wedding of Jeff Bezos (61 year old, Amazon founder) and Lauren Sanchez (55 years old, journalist) will take place over 3 days in Venice with a series of A-list guests.

The reason why the Amazon filed a lawsuit against the New York Times

Anh Vũ |

A group in the Amazon is suing major US media outlets, including the New York Times, after being accused of being addicted to pornography.

Amazon launches new AI technology with natural voice

QUANG MINH (THEO the verge) |

Amazon has just launched new artificial intelligence (AI) technology with natural voice and the ability to create smoother videos.