Latest News

The data center boom in Big Tech poses a new threat to US grid operators

Data Center Alley is a 30-square mile stretch of land outside Washington D.C. that houses more than 200 data centres. It consumes about the same amount of electricity as Boston. Power company officials were shocked when 60 data centers suddenly went off the grid last summer.

A standard safety feature in the data center industry was responsible for the mass reaction. Its purpose is to protect electronic and computer equipment from voltage fluctuations that could damage them. According to federal regulators, and utility executives, it led to a massive surge in electricity.

Grid operator PJM, and the local utility Dominion Energy were forced to reduce output of power plants in order to protect grid infrastructure. This was done to avoid a worst case scenario of a cascading of power outages throughout the region.

The near-miss, which is reported in detail here for the first time, forced federal regulators into recognizing a new vulnerability to America's electric grid: unannounced data center disconnections.

In an interview, John Moura, Director for Reliability Assessment and System Analysis at NERC said that as data centers grow and consume more power, the grid cannot withstand a loss of 1,500 megawatts of data centers. "At a certain level, it becomes too big to handle unless additional grid resources are added." Grid operators have historically planned for the possibility of large power plants going offline. Grid operators are forced to prepare for new contingencies due to the rapid growth of data centers that process the huge amounts of information needed for AI and crypto mining.

The behavior of data centres has the potential to cascade power outages across an entire region, said Alison Silverstein. She was a former senior advisor to the Chairman of the U.S. Federal Energy Regulatory Commission.

Data Center Alley, a cluster of Microsoft, Google, and Amazon facilities, is where the event took place on July 10, 2010. Around 70% of all internet traffic in the world flows through this area. The North American Electric Reliability Corporation, the federal regulator of grid reliability, formed a taskforce a month after the incident to investigate en masse disconnection by data centers and cryptocurrency miners.

This story examined thousands of pages in regulatory documents, and spoke to about a dozen executives from the industry, to find out the cause of the problem - a failed surge protection on Dominion’s Ox-Possum line, near Fairfax, Virginia, and how it spread throughout the region. NERC published a report on the incident in January, but didn't disclose the exact location, number of data centres involved or how PJM, Dominion and NERC worked to rebalance grid supply and demand.

Near-miss events are increasing.

As more data centers are brought online, the number of near misses like that in Data Center Alley is on the rise.

According to a December report by the Lawrence Berkeley National Laboratory, the amount of energy used by data centres has tripled in the last decade. It could triple again by the year 2028.

The Electric Reliability Council of Texas, the main grid operator in the state, reviewed disclosure filings and identified over 30 near-misses since 2020. These incidents were triggered by large energy consumers like data centers or crypto miners going offline.

A failed transformer in a west Texas substation caused 400 crypto-miners, data centres, and oil and gas production equipment to be unplugged without warning.

According to ERCOT, the mass exodus resulted in an excess of 1,700 megawatts - about 5% of total grid demand - forcing 112 megawatts to be shut down.

In a report published in December, NERC predicted that the risk of power failures will increase as more data centers are brought online. The report stated that the risk of energy shortages will increase in the United States over the next five to ten years.

The regulator encouraged utilities to update federal reliability standards for crypto mining and data centers.

A CONTROVERSIAL FILE

According to NERC, many data centers are designed by their operators so that they can switch to local generators as soon as there is a hint of a grid problem to minimize the risk of a service interruption like Google search or cryptocurrency mining.

Several grid operators propose that data centers "ride out" voltage dips routinely without disconnecting. Data center operators, however, are against the idea because it could damage electronic equipment and cooling system.

ERCOT retracted a proposal last year that would have imposed restrictions on ride-through data centers and crypto miner after being pushed back by an industry group. The Data Center Coalition.

Amazon, Google and Meta are among the group's members. They cited cost and risk to computer chips and cooling system exposed to fluctuations in voltage levels.

The coalition stated in comments submitted to ERCOT on January 20, 2024 that "data center hardware and power supply, like other electronics, are highly sensitive to the stability of power supply."

If you depart from this range, it will reduce the performance of your vehicle, decrease its longevity or cause irreparable damage to the components.

The coalition declined comment on this article. Amazon, Google, and Meta didn't return any messages seeking comments. ERCOT didn't return messages seeking comment. ERCOT's operations engineer Patrick Gravois told NERC’s Large Load Task Force in December that there is a "high potential" of the disconnection events becoming more severe as larger operations connect to the Texas grid.

Gravois stated that the grid operator was still trying to figure out exactly why big electricity users unplug themselves from the grid so as to avoid any surprises.

Ari Peskoe is the director of Harvard Law School's Electricity Law Initiative. He said that regulators might require data centers ride out voltage dips, but this could lead to Big Tech moving to states with more lenient rules.

Jim Simonelli is the chief technology officer of Schneider Electric's Secure Power division. He said that utilities and data centers can learn a lot from what occurred outside Washington DC in July.

Simonelli stated that the industry has not yet figured out how to make data centers grid-friendly.

(source: Reuters)