Comment Notes (Score 2) 72
Just a couple of random notes about the practicality of this.
- Some new inference data centers don't have gens. The idea is that with inference if a resource is not available it can be requested from another pool (availability zone). In these cases when the power goes out, the UPSs hold the load for 4-5 minutes to give the servers time to drop and then the site goes dark.
- Imagine 32 diesel freight train engines all powering up. That's what this is like for a site-wide utility power failure for a smallish data center. Thankfully most DCs now require an enclosure for each gen which limits the noise they produce while running.
- Most providers have between 24 and 48 hours of diesel fuel on-site. This is either in large central storage tanks or in belly tanks dedicated to each gen. A provider would have typically a 4-hour SLA on fuel delivery so once the gens start running a call is made to start running fuel trucks to the DC to begin the refueling process.