NVIDIA’s H100 GPUs Powered AI Powerhouses & Data Centers Consume Electricity Equivalent To Entire Nations

NVIDIA’s H100 GPUs Powered AI Powerhouses & Data Centers Consume Electricity Equivalent To Entire Nations

 0
NVIDIA’s H100 GPUs Powered AI Powerhouses & Data Centers Consume Electricity Equivalent To Entire Nations
The US Government Blocks Access of NVIDIA's A100 AI GPUs To a Chinese Firm, Citing Concerns of Technology Transfer 1

NVIDIA's H100 AI GPUs will reportedly reach a deployed capacity of a whopping 3.5 Million units by next year, consuming enough electricity to power entire countries.

Based on an estimated figure by the market analysis source Stock Talk, it seems like CEO Jensen Huang's AI bandwagon has established new benchmarks not only in terms of revenue figures but electricity consumption as well.

It is reported that a total of 3.5 million units of NVIDIA's H100 will consume around 13,000 GWh of electricity annually. Previously, electricity consumption was associated with the crypto mining boom back in 2020, as it was revealed that cryptocurrency mining led to the consumption of 173.42 terawatt hours of electricity.

By next year, Nvidia's ~3.5 million units of deployed H100 GPUs will consume a whopping 13,000 GWh of electricity annually, which is greater than the power consumption of some entire countries like Guatamela and Lithuania.

— Stock Talk (@stocktalkweekly) December 27, 2023

NVIDIA's H100s AI GPUs around the globe are now expected to utilize electricity equal to what countries like Guatemala and Lithuania consume yearly, which is shocking yet surprising at the same time. There is no denying the fact that Team Green's AI GPUs have seen a large-scale deployment on a global level, not only because of the company's efforts to nourish their hardware and software resources, but NVIDIA is in the lead when it comes to offering its product to the markets. In its current state, no other firm comes near NVIDIA, especially in the adoption of new AI language models and platforms.

However, things don't look to stop here, since NVIDIA plans on selling a whopping 1.5 to 2 million units next year, which means that electricity consumption figures will almost triple what they are now. It will be interesting to see how nations cope with such a situation, since with the rapidly increasing developments and demand in artificial intelligence, the amount of AI accelerators deployed is only going to increase.

Several supercomputers will become operational in the coming years housing these advanced AI accelerators from NVIDIA and its competitors so expect power consumption in the related AI industry and data center segment to continue to grow.

News Source: Stock Talk

What's Your Reaction?

like

dislike

love

funny

angry

sad

wow