What power levels are AI racks currently reaching?

NVIDIA Hopper and Blackwell server frames like the GB300 NVL72 reached around 140 kW. The newer Vera Rubin and Feynman generations are pushing to 600 kW+ for Rubin Ultra, with projections to exceed 1 Megawatt (1,000 kW) per rack by 2028–2030.

What is driving this increase in power consumption?

The rapid growth of generative AI and large language models (LLMs) has fundamentally changed assumptions. Modern AI clusters integrate more AI GPU/ASIC dies and multi-terabit SerDes switching fabrics into dense footprints, forcing architects to simultaneously optimize computing density, memory bandwidth, interconnect capacity, thermal management, and energy delivery within compact rack-scale systems.

What technology is being adopted to handle higher power demands?

The industry is transitioning to 800V HVDC power systems. Wide-bandgap semiconductors, specifically silicon carbide (SiC) and gallium nitride (GaN), are joining the supply chain because they offer competitive advantages over traditional silicon devices in managing the higher power and thermal requirements of AI data center infrastructure.

Back to articles

AI racks to hit 1 megawatt per unit by 2028–2030, reshaping power infrastructure

DIGITIMES Asia1d ago5 min read

Key takeaway

AI data center racks are consuming power at unprecedented rates, with individual units projected to exceed 1 Megawatt per rack by 2028–2030—far beyond the 140 kW of earlier NVIDIA generations. This shift is forcing a fundamental redesign of data center electrical architecture, with a move toward 800V HVDC systems and advanced wide-bandgap semiconductors to manage thermal and energy-delivery challenges in increasingly dense AI compute footprints.

Summaries like this, in your inbox every morning.

3 Key Points

What happened
AI rack power consumption is surging far beyond historical norms. NVIDIA Hopper and Blackwell server frames like the GB300 NVL72 reached around 140 kW, but the Vera Rubin and Feynman generations are pushing individual rack requirements to 600 kW+ for Rubin Ultra, with projections to exceed 1 Megawatt (1,000 kW) per rack by 2028–2030.
Why it matters
For over two decades, data center power distribution was a mature, slow-moving engineering discipline. The dense integration of AI GPUs/ASICs and multi-terabit switching fabrics means power consumption is now increasing at a pace that significantly exceeds historical infrastructure design assumptions. This forces architects to simultaneously optimize computing density, memory bandwidth, interconnect capacity, thermal management, and energy delivery.
What to watch
The industry is transitioning to 800V HVDC (high-voltage direct current) power systems, and wide-bandgap semiconductors (silicon carbide and gallium nitride) are entering the supply chain to handle the higher power demands more efficiently than traditional silicon devices.

FAQ

What power levels are AI racks currently reaching?: NVIDIA Hopper and Blackwell server frames like the GB300 NVL72 reached around 140 kW. The newer Vera Rubin and Feynman generations are pushing to 600 kW+ for Rubin Ultra, with projections to exceed 1 Megawatt (1,000 kW) per rack by 2028–2030.
What is driving this increase in power consumption?: The rapid growth of generative AI and large language models (LLMs) has fundamentally changed assumptions. Modern AI clusters integrate more AI GPU/ASIC dies and multi-terabit SerDes switching fabrics into dense footprints, forcing architects to simultaneously optimize computing density, memory bandwidth, interconnect capacity, thermal management, and energy delivery within compact rack-scale systems.
What technology is being adopted to handle higher power demands?: The industry is transitioning to 800V HVDC power systems. Wide-bandgap semiconductors, specifically silicon carbide (SiC) and gallium nitride (GaN), are joining the supply chain because they offer competitive advantages over traditional silicon devices in managing the higher power and thermal requirements of AI data center infrastructure.

Discussion

No discussion yet for this article

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →