WattThe / Data center / GPU / compute power load
Estimate the raw IT power an AI cluster draws: chip TDP × utilization × count, plus server overhead for CPUs, memory, and networking.
The standard data center formula — server power × server count ÷ 1,000 — needs one adjustment for AI facilities: the GPU dominates. A single H100 draws up to 700 W, and Blackwell-generation parts push past 1,000 W per chip, so the honest way to size an AI hall is to start from accelerator TDP, scale it by realistic utilization, and multiply by chip count. Training clusters routinely sustain 70–90% of TDP for weeks; inference fleets are burstier and often average far less.
TDP alone understates the server, though. CPUs, HBM and system memory, NICs, NVLink switches, and chassis fans add roughly 25–45% on top of GPU draw in dense AI servers, which is why this calculator carries an explicit overhead slider rather than burying the assumption. The output here is IT load only — what the racks themselves consume. Cooling and electrical losses sit on top of it, which is exactly what the cooling load and PUE calculators on this site handle next.
Two practical notes from the field: utilities and interconnection queues care about your peak coincident demand, not your average, so size interconnection requests from near-full utilization; and per-rack density is the number that drives your cooling architecture decision — above roughly 40–50 kW per rack, air cooling stops being the economical answer.
TDP (Thermal Design Power) is the maximum sustained power the chip is designed to dissipate. Real draw depends on workload: dense training jobs run close to TDP, while inference and idle periods run well below it. That is why this calculator multiplies TDP by an average utilization factor.
The SXM version of the H100 has a 700 W TDP; the PCIe version is 350 W. A typical 8-GPU H100 server draws roughly 8–10 kW at high utilization once CPUs, memory, networking, and fans are included.
GPUs are only part of the server. Host CPUs, memory, storage, network cards, and chassis fans typically add 25–45% on top of accelerator draw in AI-optimized servers, so ignoring them understates the load your electrical and cooling systems must carry.
Estimates are for planning and education, not engineering design or financial advice. Verify rates with your utility and confirm electrical work with a licensed engineer or electrician.
Join the WattThe list for state rate updates, new calculators, and a deeper walkthrough of your numbers. Commercial or data center project? Reply to any email for a feasibility review.
No spam. One or two emails a month, unsubscribe anytime.