The Journal.

The Power Grid's AI Problem

18 min
Jan 21, 20264 months ago
Listen to Episode
Summary

AI data centers are straining the US power grid operated by PJM Interconnection across 13 states, creating surging electricity demand that outpaces supply. The episode explores how this unprecedented demand is driving rate hikes, potential blackouts, and a complex policy response involving the Trump administration and governors seeking solutions.

Insights
  • AI data center demand represents a fundamental shift in US electricity consumption after 20 years of flat demand, comparable to the advent of air conditioning
  • Power supply infrastructure cannot scale as quickly as data center deployment, creating a structural mismatch between demand growth and generation capacity
  • Price caps provide short-term consumer relief but reduce market incentives for power plant construction, potentially worsening long-term supply shortages
  • Tech companies are resisting responsibility for the grid crisis, arguing systemic under-investment rather than their demand is the root cause
  • Solutions are shifting costs to data center operators through 15-year power contracts, on-site generation requirements, and demand-response obligations
Trends
Explosive growth in AI data center construction concentrated in specific regions (Northern Virginia 'data center alley')Shift from regulated utility model to market-based solutions requiring tech companies to self-supply or guarantee long-term power purchasesBipartisan political pressure on grid operators and tech companies to address affordability and reliability simultaneouslyData centers deploying on-site power generation as interim solution while grid infrastructure catches upFederal government intervention in regional electricity markets to address tech-driven demand shocksRegulatory focus on demand-response mechanisms requiring large consumers to curtail usage during peak periodsTension between environmental goals (coal plant closures) and reliability needs creating supply constraintsGeographic arbitrage by tech companies shopping for favorable tax incentives complicating utility planning
Topics
AI Data Center Power ConsumptionGrid Operator Capacity PlanningElectricity Rate HikesPower Supply and Demand ImbalanceBlackout Risk ManagementEnergy Market RegulationOn-Site Power GenerationLong-Term Power Purchase AgreementsRegional Electricity MarketsInfrastructure Investment TimelinesPeak Demand ManagementTech Industry Energy CostsFederal Energy PolicyState Governor InterventionPower Plant Construction Economics
Companies
PJM Interconnection
Grid operator overseeing 13 states and 67 million people; facing strain from AI data center demand and potential blac...
Google
Major AI data center developer building facilities in PJM territory, particularly in Northern Virginia data center alley
Microsoft
Large AI data center operator in PJM region; Brad Smith responded to Trump administration meeting on grid solutions
Data Center Coalition
Trade group representing tech and data center companies; disputes responsibility for grid crisis, cites systemic unde...
People
Jennifer Hiller
Wall Street Journal colleague who has been investigating PJM and the grid operator's challenges with AI data center d...
Brad Smith
President of Microsoft; posted on X that Trump administration meeting was a strong starting point for grid solutions
Governor Shapiro
Pennsylvania governor who filed complaints with federal regulators about PJM market and sought price caps
Ryan Knudsen
Host of The Journal podcast episode on power grid and AI data center challenges
Quotes
"They are kind of like air traffic control for the electricity market and making sure that supply and demand are in balance."
Ryan KnudsenEarly in episode
"A large data center can eat up a gigawatt of power or more. That's like an entire city."
Jennifer HillerMid-episode
"The system is getting more stressed in different ways and the risks are rising."
Jennifer HillerDiscussion of blackout risk
"You don't want to underbuild and not be able to serve customers and you don't want to overbuild and then be charging people for infrastructure that maybe wasn't needed."
Jennifer HillerPower plant planning discussion
"The price rising is supposed to be a market signal to the owners of power plants to go build more of them."
Jennifer HillerPrice cap discussion
Full Transcript
One of the biggest players in the US power industry is called PGM Interconnection. PGM oversees the energy market across 13 states, from New Jersey to Pennsylvania to Kentucky, and serves about 67 million people. Where your electricity comes from is something that I feel like most Americans are usually pretty lucky not to have to think about. Really none of us should know who PGM is. Normal people should not really be thinking about who their grid operator is. Unlike most normal people, my colleague Jennifer Hiller has been thinking about PGM a lot. They are kind of like air traffic control for the electricity market and making sure that supply and demand are in balance. And right now, PGM has a problem. AI data centers are putting a huge strain on the power grid. So data centers are a really big new customer essentially for the power grid. And it's almost like endless or bottomless. How much energy they are asking to use. A large data center can eat up a gigawatt of power or more. That's like an entire city. So that's one customer saying I need the power of a whole city right here. There's so much demand for power that the supply is struggling to keep up. And it's pushing PGM to the brink. Is it possible that this could lead to a situation where there has to be blackouts? Well, nobody is ever happy to lose power. And definitely blackouts are the situation that you want to avoid at all costs. But the system is getting more stressed in different ways and the risks are rising. Welcome to the journal, our show about money, business and power. I'm Ryan Knudsen. It's Wednesday, January 21st. Coming up on the show, can America's biggest grid operator keep the lights on? The world moves fast. You work day, even faster, pitching products, drafting reports, analyzing data. Microsoft 365 co-pilot is your AI assistant for work built into word, Excel, PowerPoint and other Microsoft 365 apps you use helping you quickly write, analyze, create and summarize. So you can cut through clutter and clear path to your best work. Learn more at Microsoft.com slash M365 co-pilot. For companies in the power industry, this huge new demand for power is a big change. For years, electricity consumption in the US was actually staying pretty flat. Across much of the country, for about 20 years, there really wasn't a lot of increase in power demand. That's surprising because I feel like over time there would be more and more energy consumption. Yeah, you would think that. But a lot of things got more efficient. So you would have more efficient buildings or LED lights and things like that. And so it kind of tamped down demand for electricity. We're going to go us. Yeah. But now we are suddenly in a period where we have AI and you know, all of the tech companies need to continue to build and develop their AI models. And we are all using AI and we think of all of this stuff as kind of being off in the cloud somewhere. But it's really in a data center. Many of the new AI data centers, which are being built by companies like Google and Microsoft, are cropping up in one area within PJM's territory known as data center alley. So data center alley is in northern Virginia and it is kind of just a big concentration of data centers. Data centers, these hulking concrete boxes filled with servers, guzzle electricity. And in the past few years, dozens of them have been built there. Thanks to all these data centers, PJM expects power demand to grow about 4.8% a year on average the next decade. In other industries, 4.8% might not sound like that much, but it's a really big system. And so if you're adding, you know, growth like that onto a really large system, it's just a lot more customers. It's a lot more infrastructure that needs to be built to be able to serve them. I mean, some people compare this to the advent of air conditioning or a lot of home appliances. You know, people working in the industry now have not seen anything like this. Up until recently, PJM had almost the opposite problem. There was too much power generation. Well that made power prices pretty cheap. And so a lot of plants shut down because they couldn't afford to keep operating. So you had some plants closing down simply because of market reasons. And you also had states that have environmental targets and things like that where they wanted to maybe close some of their aging coal plants early, some of their older gas plants early. And so you kind of had that dynamic going on in like the years leading up to now. They had a lot of power in PJM. They had too much power. They had so much power that you couldn't afford to operate some of these power plants. Which means the supply of reliable power has actually been decreasing. And everyone knows what happens when you have increasing demand and shrinking supply. We are talking about your money, specifically rising electricity costs. So right now it's making people really furious in the PJM system. Not the year end news you probably want to hear, but your energy costs are going to go up again. Power grid operator PJM is under fire over significant electricity rate hikes across its 13 states. In a state like New Jersey, I believe in June, they saw bills increase about 20%. Wow, I'm sure people in New Jersey love that. Yeah, it's been real popular there. It's not just higher bills that are the problem. Demand is going up so fast that an independent market monitor for PJM warned that it could have to manage blackouts during periods of peak demand if they don't find a solution. So what's PJM going to do about all this? That's after the break. When the tax year ends on the 5th of April, valuable tax allowances may be lost simply because people left things too late. Thankfully, Vanguard is here to help you make well-considered decisions, not rushed ones. Their tax year end hub is full of clear guidance, helpful tools and timely reminders to help you understand your allowances and give your investments the best chance to grow. Search Vanguard Investor to learn more when investing your capital is at risk taxable supply. Could AI help you do more of what you love? Workday is the next Gen ERP powered by AI that actually knows your business. We help you handle the half to do so you can focus on the can't wait to do. It's a new workday. There's an obvious solution to bring down people's electricity bills, increase the supply of electricity, build more power plants, but it's actually not that simple. One issue is that you can build a data center, a heck of a lot faster than you can build a power plant or a new substation or big transformers and get the power grid out to them. Everything's just become so much more expensive from materials to labor. You can't get a turbine for the next four or five years. Another reason it's complicated is because data center companies tend to shop around different places, looking for things like the best tax incentives, which means it's hard for utility companies to predict exactly where data centers will get built. And if they build a power plant and a data center doesn't show up, then they'll have too much power, which is also a problem. You don't want to underbuild and not be able to serve customers and you don't want to overbuild and then be charging people for infrastructure that maybe wasn't needed. There's I guess kind of layers of complication that go into where do you actually put the power plant? Are you sure enough of this market for the next, you know, have for many years to have confidence to put a few billion dollars into, you know, building a power plant of some kind? So it's very difficult on the ground, essentially. While the power in tech industries are trying to sort this out, politicians are losing patience. Governors have been really unhappy about these price increases and that, you know, this has become such an issue that in Pennsylvania, Governor Shapiro has filed complaints with federal regulators about the PJM market among the things that he was asking for. It was a price cap, which he did get, but you're seeing a lot of just unhappiness from the group of governors as a whole where they want to have more involvement and kind of oversight on how prices are determined. While a price cap like the one in Pennsylvania can bring relief to consumers in the short term, it can also reduce the incentive for companies to build new power plants. The price rising is supposed to be a market signal to the owners of power plants to go build more of them. You know, there are a lot of companies that own power plants that would say, you know, we need to see that market signal to have confidence to build. Yeah, I might put a lid on prices now, but it doesn't solve the problem in the long run. Exactly. Last Friday, the Trump administration also got involved. So what happened last week is that you had a big bipartisan meeting of the Trump administration and 13 governors trying to hash out what they would like to see happen in PJM and some things that would maybe be able to address those rising prices. By partisan group of governors from Pennsylvania, Ohio and Virginia will reportedly meet at the White House today to sign a statement of principles aimed at bringing more power into the 13 state markets that are overseen by grid operator PJM interconnection. This is all one of the big directives out of the meeting is that PJM should give 15 year contracts to power plant developers promising to buy power to guaranteed price. And that AI data center companies, not consumers will be required to foot the bill. Basically, they're saying you guys are the new big user that is coming into the system that is sort of creating or revealing this problem of, you know, we don't have enough power in PJM. And so you should bear the cost of like the new generation that is going to need to get built. After the meeting PJM put out its own set of proposals, which in addition to the 15 year contracts for new power plants, included a few other solutions that will also put more onus on the tech companies. One of those is that they BYOB, or in this case, actually BYOP, they have to bring their own power. Data centers can bring their own power generation that would be maybe on site or nearby, bring your own power. You're hearing it across the country. You're seeing it in a lot of places in Texas and Tennessee and Ohio and all sorts of places. You are seeing large data center projects that are bringing on site power with them. And they are planning to either in a few cases island themselves and just provide their own power forever or just use it as a bridge until, you know, all of the grid infrastructure can catch up and then they will connect at some point. Another solution PJM is proposing is to pressure data centers to go offline during periods of peak demand. The grid operator will tell you from time to time, you know, we need you to go offline, we need you to go to your backup power. How do the tech companies respond to this new plan from PJM and the Trump administration? So I know that the data center coalition, which is a trade group that represents a lot of the big tech companies and data center companies, has said that they don't accept the argument that they are causing this problem. They say that the grid and the system has just been under-invested. And they're, you know, happy to participate in figuring out the solution to all of this, but that there are other issues. So it's not, you know, they're saying it's not a problem of their creation. The president of Microsoft Brad Smith posted on X that the meeting with the Trump administration was quote, a strong starting point. And they quote, we look forward to engaging with stakeholders as this important work moves forward. We talked earlier about how if PJM can't get this solved, it might need to eventually resort to blackouts. How likely is that right now? That's one of the things that's really hard to predict because, you know, a lot of factors would go into that and you would have to have kind of an extreme weather situation. You have these certain hours of the year, usually if it's extremely hot or extremely cold, where things become stressed. And so the risk is really in a small number of hours of year, but it's just that we see that risk rising and this has been flagged by federal oversight officials and things like that, just that risks are rising across the electricity system. So I don't want to paint this picture of that. We're just corigning into this era of rolling blackouts because I don't think that will be the case. Do you think PJM has all this figured out or do we still have a ways to go before this problem is actually solved? This is such a good question. This continues to be a huge bite in PJM in the near term. And I also think this is still kind of early innings for how this plays out in other places across the country because we are really kind of just on the cusp of seeing all of this new demand and we don't know why exactly what it looks like exactly where these data centers will locate exactly how they're going to be using power. And so I think a lot of this is to be determined. That's all for today. Wednesday, January 21st. The journal is a co-production of Spotify and the Wall Street Journal. Additional reporting in the sepals load by Katherine Blunt, Umrthram Kumar and Scott Patterson. Thanks for listening. See you tomorrow.