Lesson 5 of 9 · about 17 minutes
Power Systems: From the Substation to the Server
You'll be able to
- Trace the power path from utility feed to server power supply
- Explain what a UPS, battery string and diesel generator each do and for how long
- Read redundancy shorthand: N, N+1, 2N, 2N+1
- State what each Uptime Institute Tier requires, and what it does not promise
A data center's power system has one job: the servers must never see the lights flicker. Even when a breaker fails at 3 a.m. during a thunderstorm. Everything in this lesson exists to make that promise, and the cost of keeping it explains why data center electrical rooms look like small utilities.
The power path
- Utility feeds. Big campuses connect at transmission voltage, often 69 kV to 345 kV, sometimes through a substation built just for them. Two feeds from different substations protect against one line going down.
- Substation. Transformers step the voltage down to medium voltage (often 12 to 35 kV) for distribution around the campus.
- Switchgear. Rooms of large breakers route power to each hall and isolate faults. Automatic transfer switches move the load to generators when the utility fails.
- UPS. The uninterruptible power supply cleans up the power and, the instant the utility fails, carries the load from stored energy. Lithium-ion batteries have largely replaced lead-acid in new builds; some sites use spinning flywheels. Battery time is usually sized for minutes, enough to cover generator start-up and a few retries, not hours.
- Generators. Diesel generators, often 2 to 3 MW each, start within seconds and carry the site until the utility returns. Fuel on site commonly covers a day or two, with refueling contracts for longer. A 300 MW campus can have more than 100 of them.
- PDUs and server power supplies. Power is stepped down again and divided rack by rack. Each server usually has two power supplies fed from separate paths.
AI is changing the last steps. Racks drawing 100 to 200 kW need so much current at traditional voltages that cables and bus bars get huge. Nvidia and partners are moving toward 800-volt direct current distribution to cut current and conversion losses. Expect new AI halls to look different inside the electrical room.
Redundancy shorthand
N is the amount of equipment needed to carry the full load. Everything else is described relative to it.
| Notation | Meaning | Example with a 4 MW load and 1 MW UPS modules | What it survives |
|---|---|---|---|
| N | Exactly enough | 4 modules | Nothing. Lose one module and you drop load. |
| N+1 | One spare | 5 modules | One component failure or one unit out for service |
| N+2 | Two spares | 6 modules | One failure while another unit is down for maintenance |
| 2N | Two complete independent systems, each able to carry everything | 8 modules in two separate systems, A and B | Loss of an entire system, including its wiring path |
| 2N+1 | Two systems plus a spare | 9 or more modules | Loss of one system plus a component in the other |
Worked example: what redundancy costs
The invented Mesa Verde Data campus has a 60 MW critical load. Generators are 3 MW each.
- N: 60 divided by 3 = 20 generators
- N+1: 21 generators
- 2N: 40 generators
Going from N+1 to 2N doubles nearly all the electrical gear for an extra 19 generators, each a large purchase plus fuel, permits and maintenance. That is why many hyperscalers run N+1 or similar block designs and rely on software to move work between buildings and zones when something fails. Banks and colocation sites selling to many tenants are more likely to pay for 2N.
Uptime Institute Tiers
The Uptime Institute's Tier Classification System is the most cited rating for data center infrastructure. Uptime certifies designs and constructed facilities separately; a developer saying "Tier III design" is not the same as a certified Tier III constructed facility. The Tier pages describe what each level must deliver:
| Tier | Name | Redundant components? | Redundant distribution paths? | Maintain without shutdown? | Survive an unplanned failure? |
|---|---|---|---|---|---|
| I | Basic capacity | Not required | No | No: maintenance needs a full shutdown | No |
| II | Redundant capacity components | Yes (generators, UPS, chillers) | No | Components yes, distribution path no | No |
| III | Concurrently maintainable | Yes | Yes | Yes: any part can be shut down without affecting IT | Not guaranteed |
| IV | Fault tolerant | Yes, in physically isolated systems | Yes, isolated | Yes | Yes: one event should not take out both systems; continuous cooling required |
You will often see availability percentages next to Tiers, such as "Tier III equals 99.982 percent." Uptime's current Tier pages do not set numeric availability targets. Those figures come from older material and marketing. If a developer cites one, ask where it comes from. Real-world availability depends heavily on operations and staff, which Uptime rates separately.
Generators and the neighbors
Diesel generators are the part of the power system that neighbors notice. They are tested regularly, often monthly, which means noise and exhaust. Federal rules for emergency compression-ignition engines (40 CFR 60.4211(f)) allow up to 100 hours a year for maintenance and testing, of which up to 50 may be used for limited non-emergency purposes; true emergencies are not capped. States issue air permits, and those permits list the number of engines, their size and the allowed hours. Some campuses now use natural gas generators or large batteries instead, and some sign deals to run generators during grid emergencies, which local air regulators watch closely.
When the backup system surprises the grid
On July 10, 2024, a lightning arrester failed on a 230 kV line in the Eastern Interconnection in an area with many data centers. The line's automatic reclosing made repeated attempts, producing six faults in 82 seconds. Data center control systems that count voltage dips moved about 1,500 MW of load to backup power, and roughly 1,260 MW stayed off the grid for hours. The North American Electric Reliability Corporation (NERC) reviewed the event because a sudden loss of that much load can push grid frequency and voltage too high. The protection worked for the data centers; it surprised the grid. Utilities are now writing rules for how large loads must ride through disturbances.
Common mix-ups
- Claim: Data center generators run all the time. What the evidence shows: Emergency generators mostly sit idle and run for testing and outages. Hours are capped by federal rules and state permits. Some sites with on-site gas plants are different; check the permit.
- Claim: Tier IV means the site will never go down. What the evidence shows: Tier IV designs tolerate one fault, but human error, software failures and network problems cause many outages (lesson 9).
Reporting angle
- Request the facility's air permit application from your state environmental agency. It lists every generator, its size in kW or MW, fuel type, permitted hours and estimated emissions.
- Ask the utility for the interconnection voltage, whether a new substation or line is needed, and who pays for it.
- Ask what the site does during grid emergencies: does it drop to generators to free up grid power, and is it paid to do so?
- If a developer claims a Tier rating, check Uptime Institute's public list of certified facilities.
Research angle
- Uptime Tier Classification: What each tier level claims and how sites get certified.
- 40 CFR 60.4211: Federal rule on emergency generator engines.
- EPA stationary engines: Agency page on engine air rules.
- NERC large load loss review: Incident review of data centers dropping off the grid at once.
- LBNL 2024 report, full text: Full report with the assumptions on power, cooling and water.
Check yourself
1. During a utility outage, what carries the servers in the seconds before generators take over?
The uninterruptible power supply keeps power steady with stored energy for the seconds to minutes needed for generators to start and take the load.
2. A facility needs 4 generators to carry its full load and has 5 installed. How is that written?
N is the number needed. One spare beyond that is N+1. 2N would be 8, two complete sets.
3. What does Uptime Institute's Tier III add over Tier II?
Tier III is defined as concurrently maintainable. Tier IV adds fault tolerance. The Tier standard itself does not set availability percentages.
4. Under federal rules (40 CFR 60.4211(f)), how many hours a year may an emergency diesel engine run for maintenance and testing?
The rule allows up to 100 hours per calendar year for maintenance and readiness testing, with up to 50 of those for limited non-emergency use. True emergencies are not time-limited.
5. In the July 10, 2024 event NERC reviewed, why did about 1,500 MW of data center load suddenly drop off the grid?
A failed lightning arrester caused a fault; three reclose attempts produced repeated disturbances, and data center controls moved their load to backup power, which grid operators had not expected.
6. Why do many campuses get two separate utility feeds?
Two independent feeds, ideally from different substations, protect against one line failing.
Terms in this lesson
- Substation
- A facility with transformers and switches that steps transmission voltage down to a voltage a site can use.
- Switchgear
- Large breakers and switches that route, protect and isolate electrical circuits inside a facility.
- UPS
- Uninterruptible power supply: equipment that conditions power and supplies stored energy instantly when the utility fails.
- Automatic transfer switch (ATS)
- A switch that moves a load from utility power to generator power and back without a person throwing it.
- N, N+1, 2N
- Shorthand for redundancy: N is what the load needs, N+1 adds one spare, 2N is two complete independent systems.
- Concurrently maintainable
- Built so any component or path can be taken out for maintenance without shutting down the IT load. The core of Uptime Tier III.
Sources
- Uptime Institute: Tier Classification System checked 2026-10
- eCFR: 40 CFR 60.4211, compliance requirements for stationary CI engines checked 2026-10
- EPA: Controlling Air Pollution from Stationary Engines checked 2026-10
- NERC: Incident Review, Considering Simultaneous Voltage-Sensitive Load Reductions (large load loss) checked 2026-10
- LBNL: 2024 United States Data Center Energy Usage Report (UPS efficiency assumptions) checked 2026-10
- 2CRSi: Nvidia from Blackwell to Rubin, power and cooling (800 VDC) checked 2026-10