GPU OWNERS

GPU Colocation Power Budget: Check the Site Limit

In this article
THE QUICK TAKE

A site power assessment needs the whole host and the applicable circuit boundary, not a sum of GPU names or PSU ratings.

A GPU colocation power budget starts with the site’s permitted electrical capacity and the complete system’s requirements. Check the applicable circuit or allocation, operating modes and other equipment sharing that boundary. Adding the ratings printed on installed power supplies is not a measurement of actual server consumption.

The owner should prepare the information; qualified site personnel determine the appropriate electrical arrangement. This worksheet does not replace the manufacturer’s installation requirements or the site’s assessment.

Read the complete system requirements

Record the exact host model, installed components and power configuration. NVIDIA’s DGX H100/H200 documentation illustrates why a system has model-specific supply requirements. Those requirements cannot be applied unchanged to an arbitrary workstation.

A GPU’s advertised power figure describes only part of the machine. CPU, RAM, drives, networking and power conversion also matter. Conversely, installed PSU capacity does not mean the host continuously consumes that amount.

Establish the site’s boundary

Ask what the limit covers and in which units it is expressed. Is it a server allocation, circuit, cabinet or a broader site constraint? Identify equipment already using the same allowance and any conditions on continuous operation.

QuestionEvidence to requestWhy it matters
What is limited?Named circuit or allocationDefines the calculation boundary
What is already connected?Current equipment recordAvoids counting capacity twice
Which system is proposed?Exact configurationSupports manufacturer checks
Who approves connection?Responsible site contactEstablishes the next decision

Keep unresolved electrical details marked as unresolved. A numerical estimate should not be presented as an approval to connect additional hardware.

Observe several operating modes

Measure the intended host during startup, idle operation and the representative workload using an appropriate method. NVIDIA SMI can contribute GPU observations, but those are not automatically the complete wall-power measurement.

Record the period and source for every value. A short peak, an average and a configured limit answer different questions. If other equipment shares a measurement, state that limitation rather than attributing the full reading to one server.

Turn the record into a site discussion

Provide the configuration, proposed schedule, measured observations and outstanding questions to the responsible site specialist. Include cooling and access requirements in the wider placement assessment. An adequate power allocation alone does not establish readiness for sustained operation.

Include the available capacity as documented by the site, without publishing sensitive access details. This makes an initial feasibility discussion possible before any workload, relocation or operating arrangement is assumed.

Continue with GPU Server Electricity Costs: Reconcile an Actual Bill and Offer Your GPU Server Without Relocating It.

Official references

← All articles