A single Blackwell B200 GPU draws up to 1,200 watts, and packing 72 of them into an NVIDIA GB200 NVL72 rack pushes power density to roughly 120 kW — more than ten times a traditional rack's 5–10 kW. xAI's Colossus cluster already pulls an estimated 250 MW across about 100,000 H100 GPUs, while industry PUE averages 1.54 against Google's 1.09. Cloud operators now list electricity supply as a primary constraint on where new data centers can be built.
Why does AI draw more power than traditional cloud computing?
AI workloads consume more power than conventional cloud services because training and inference keep large fleets of high-power GPUs running near full utilization for extended periodsCITE:E6. This sustained near-peak load, combined with dense accelerator packing, generates far more heat than typical servers, pushing operators toward liquid cooling to manage the resulting thermal loadCITE:E6.
How much power does a single AI accelerator draw?
NVIDIA's H100 draws 700 watts, its liquid-cooled Blackwell B200 draws up to 1,200 watts, and AMD's MI325X draws 1,000 wattsCITE:E1. A single high-end AI GPU running at full load now consumes power on the scale of several households combinedCITE:E1.
| Accelerator | Power draw |
|---|
| NVIDIA H100 | 700 W |
| NVIDIA B200 (liquid-cooled) | 1,200 W |
| AMD MI325X | 1,000 W |
How much does packing GPUs into a rack raise power density?
NVIDIA's GB200 NVL72 rack reaches a design power density of about 120 kW, versus 5–10 kW for a traditional non-AI rackCITE:E2. Reported real-world deployments of the GB200 NVL72 draw 130–132 kW, more than ten times the traditional baseline, which is why data centers hosting these racks have shifted to liquid coolingCITE:E2.
| Rack configuration | Power density |
|---|
| Traditional (non-AI) rack | 5–10 kW |
| GB200 NVL72 (NVIDIA design value) | ~120 kW |
| GB200 NVL72 (reported deployments) | 130–132 kW |
How does energy efficiency differ across hyperscale operators?
Power usage effectiveness (PUE), where a value closer to 1 indicates better efficiency, averages 1.54 across the industry, while Google's fleet-wide PUE over the trailing 12 months stands at 1.09CITE:E3. Efficiency management has become a competitive threshold in the AI era as a resultCITE:E3.
| Operator | PUE |
|---|
| Industry average | 1.54 |
| Google (fleet-wide, trailing 12 months) | 1.09 |
How large have AI data center clusters grown?
xAI's Colossus cluster reportedly runs approximately 100,000 NVIDIA H100 GPUs and draws roughly 250 MWCITE:E4. Large AI data centers are moving from hundreds of megawatts toward gigawatt-scale power draw, according to reports tracking this fast-changing trendCITE:E4.
Why is the power grid becoming the bottleneck for AI expansion?
Cloud operators now treat electricity supply as one of the primary bottlenecks on data center expansion, since concentrated high-power loads place unprecedented pressure on regional gridsCITE:E5. Where new data centers get built increasingly depends on whether the site can secure stable, sufficient powerCITE:E5.
What this means
The power ladder runs in one direction — from a 700–1,200-watt chipCITE:E1, to a ~120 kW rackCITE:E2, to a ~250 MW clusterCITE:E4 — and every step up adds pressure to the regional grid that must supply itCITE:E5. The 1.54-versus-1.09 PUE gapCITE:E3 shows some operators absorbing part of that pressure through efficiency, while the underlying driver — GPUs held near full utilization for extended periodsCITE:E6 — keeps demand at the top of the ladder climbing.
Author's Take・Nathan
The numbers here describe a stack, not a data point: a 1,200-watt B200 chip, a 120 kW rack, and a 250 MW cluster are the same power problem measured at three different altitudes. What stands out is that the GB200 NVL72's design target of ~120 kW is already being exceeded in reported deployments at 130–132 kW — density is running ahead of the reference spec, not behind it. The PUE split (1.54 industry average versus Google's 1.09) suggests efficiency engineering is becoming a second axis of competition alongside raw compute, since every fraction of a point saved scales with cluster size. The metric worth watching next is whether reported cluster power draw — xAI's Colossus at roughly 250 MW today — actually reaches full gigawatt scale, since that threshold is where grid-side constraints, not chip or rack design, become the limiting factor.