The Future of Nvidia’s H200 in China and the Pentagon's New AI Strategy
60 min
•Jan 22, 20263 months agoSummary
This episode examines the Trump administration's new H200 chip export policy to China and its immediate rejection by Beijing, alongside the Pentagon's aggressive new AI strategy emphasizing rapid deployment and removal of bureaucratic barriers to AI integration across military operations.
Insights
- China's H200 import ban may be a negotiating tactic to secure access to more advanced chips (Blackwell, Vera Rubin) rather than a permanent rejection, reflecting internal Chinese government tensions between AI companies wanting access and domestic chip makers wanting protection
- The Pentagon's AI strategy prioritizes removing bureaucratic blockers (data access, ATO processes, contracting) as much as increasing funding, recognizing that organizational friction, not just resources, limits military AI adoption
- The 25% revenue-sharing deal between Trump and NVIDIA appears structured as a 'security review fee' rather than an export tariff to circumvent constitutional restrictions on export taxes
- Chinese AI leaders face a severe compute disadvantage that limits algorithmic innovation—they're forced to optimize for efficiency rather than experiment, creating a compounding gap with US companies
- The Pentagon's requirement for state-of-the-art AI models updated within 30 days of commercial release signals aggressive AI adoption but creates significant cybersecurity certification challenges
Trends
Geopolitical AI competition intensifying through chip export controls and counter-restrictions rather than open market accessMilitary AI adoption shifting from research/pilots to operational warfighting integration with enforcement mechanisms tied to budget cutsChinese domestic chip ecosystem (Huawei, SMIC) gaining political influence to block foreign competition despite harming Chinese AI companies' competitivenessRegulatory workarounds replacing direct policy tools—using 'security review fees' instead of tariffs, 'wartime footing' language to bypass normal procurement processesCompute becoming the primary constraint on AI capability development, with access disparities creating long-term competitive advantagesPentagon moving toward agentic AI deployment across enterprise workflows, not just chatbot interfaces, with reliability challenges in mission-critical contextsData access and authorization-to-operate processes identified as primary bureaucratic blockers to military AI deployment, now subject to escalation authoritySimulation-based AI training for military applications expanding, with acknowledged risks around sim-to-real transfer and reinforcement learning exploitation of simulation gaps
Topics
H200 Chip Export Controls to ChinaTrump Administration AI Chip PolicyPentagon AI Strategy and Military IntegrationUS-China AI Competition and Compute AccessBureaucratic Barriers to Military AI AdoptionData Access and Security Clearances in DoDAuthority to Operate (ATO) Process ReformPace-Setting Projects (PSPs) in Military AIAgentic AI Deployment in Enterprise WorkflowsAI-Enabled Simulation and WarfightingChinese Domestic Chip Industry (Huawei, SMIC)Constitutional Restrictions on Export TariffsThird-Party Chip Verification and TestingEnd-User Restrictions on Military AI ChipsGenerative AI Model Currency and Updates
Companies
NVIDIA
Central to H200 export policy; negotiated 25% revenue-sharing deal with Trump; subject to new BIS export rules and Ch...
Alibaba
Chinese AI leader seeking H200 access; exec Lin Junyang stated only 20% chance China surpasses US in AI within 3-5 ye...
Baidu
Chinese AI company competing for limited H200 chip allocation under new export rules
Tencent
Chinese tech giant seeking H200 chips; represented in AGI Next Frontier Summit panel discussing compute constraints
ByteDance
Chinese company competing for H200 chip access under new export restrictions
DeepSeek
Chinese AI company represented in AGI summit panel; seeking H200 access amid export controls
Huawei
Domestic Chinese chip maker benefiting from H200 ban; pushing self-reliance strategy to protect market share from NVIDIA
SMIC
Chinese semiconductor manufacturer advocating for H200 ban to protect domestic chip ecosystem from NVIDIA competition
AMD
MI325X chips included in export calculations; China could acquire equivalent compute to 900,000 H200s via AMD and NVI...
OpenAI
US AI leader; potential customer competing with China for chip access; subject to certification requirements in expor...
Microsoft
Major US AI customer; potential competitor with China for chip allocation; invested in Anthropic alongside NVIDIA
Google
US AI company potentially competing with China for H200 chip access under new export restrictions
Anthropic
AI safety company; received NVIDIA and Microsoft investment; CEO Dario Amodei opposes H200 exports despite financial ...
Grok/xAI
Operates Colossus supercluster with ~1M chips; referenced as largest AI computing facility for scale comparison
Department of Defense
Released new AI strategy emphasizing rapid deployment, data access, and removal of bureaucratic blockers to military ...
Bureau of Industry and Security (BIS)
Issued January 13 rule specifying H200 export conditions, security review requirements, and restrictions to China
Center for a New American Security (CNAS)
Published detailed analysis of H200 export rule; provided calculations on chip allocation thresholds for China
Council on Foreign Relations (CFR)
Chris McGuire published criticism of export policy as 'strategically incoherent and unenforceable'
CSIS
Greg Allen's current employer; Center for Strategic and International Studies where he analyzes AI policy
People
Greg Allen
Co-host; former Director of Strategy and Policy at Joint Artificial Intelligence Center; analyzes Pentagon AI strateg...
Sadie McCullough
Co-host of The AI Policy Podcast; leads discussion on H200 exports and Pentagon strategy
Jensen Huang
NVIDIA CEO; negotiated 25% revenue-sharing deal with Trump on H200 exports to China
Donald Trump
President; announced H200 export allowance to China; administration issued new BIS export rules
David Sachs
Trump administration AI czar; cited as advocating for China addiction to US technology ecosystem benefits
Pete Hegseth
Secretary of Defense; distributed new Pentagon AI strategy memo to senior leadership
Lin Junyang
Tech lead for Alibaba's Qwen model; stated only 20% chance China surpasses US in AI within 3-5 years due to compute c...
Dario Amodei
Anthropic CEO; publicly opposes H200 exports despite company receiving NVIDIA and Microsoft investment
Janet Egan
CNAS analyst; co-authored detailed report evaluating H200 export rule published January 16
James Sanders
CNAS analyst; co-authored detailed report evaluating H200 export rule published January 16
Chris McGuire
Council on Foreign Relations expert; published criticism of export policy as strategically incoherent and unenforceable
Leonard Heim
Podcast contributor; posted analysis suggesting China lacks accurate picture of domestic AI chip production capabilities
Sam Hammond
Posted X commentary comparing US and Chinese policymaker mistakes on AI timelines and AGI development
Marco Rubio
Trump administration official; previously echoed criticisms of end-user restrictions on chip exports as ineffective
Xi Jinping
Chinese leader; policy of self-reliance reflected in Made in China 2025; may be influenced by Huawei on H200 ban
Quotes
"it would be a big mistake to ship these chips. I think this is crazy. It's a bit like selling nuclear weapons to North Korea."
Dario Amodei•January 20, Davos World Economic Forum
"U.S. compute is one to two orders of magnitude ahead. But more critically, OpenAI and others are putting massive compute into next-gen research. Here, we're barely keeping up with daily delivery, which already exhausts most of our compute."
Lin Junyang•January 10, AGI Next Frontier Summit
"we must put aside legacy approaches to combat and ensure we use this disruptive technology to compound the lethality of our military. Exercises and experiments that do not meaningfully incorporate AI and autonomous capabilities will be reviewed by the Director of Cost Assessment and Program Evaluation for Resourcing Adjustment."
Pentagon AI Strategy Memo
"wartime approach to blockers. We must eliminate blockers to data sharing, authorizations to operate, test and evaluation and certification, contracting, hiring, and talent management, and other policies that inhibit rapid experimentation and fielding."
Pentagon AI Strategy Memo
"the new AI chip export policy to China, strategically incoherent and unenforceable."
Chris McGuire
Full Transcript
Welcome back to the AI Policy Podcast. I'm Sadie McCullough, and I'm back as always with Greg Allen to talk about the future of NVIDIA's H200 chip in China and the Pentagon's new AI strategy. Greg, thanks so much for being back. Great to be back with you, Sadie. All right. Well, let's jump right back in to recent developments regarding H200 chips exports to China. So on January 13th, BIS issued a new rule specifying conditions for H200 exports. The next day, China blocked H200 chips from entering its borders. So before we discuss China's decision, let's unpack the new rule for our listeners. So, Greg, can you tell us what's in it and what process does it create for exporting these chips? Sure. So to help everyone understand where we are in this story, President Trump had already announced that he was going to allow exports of H-200s. But that is the sort of high level decision. There's also the nitty gritty part of the decision, which is like, how is this going to happen? How is this going to be implemented? And the way this has come out is a new rule issued by the Department of Commerce Bureau of Industry and Security. And this gets to the specifics of what is going to be allowed, under what conditions, in what time frame. And we got a lot of additional detail. Essentially, this is trying to take things that Trump has already decided we're going to do and figure out by what mechanism they are going to be legal. and to also figure out by what mechanism they are going to be enforced legally and put into practice. So to give you one example of something that this did, President Trump had previously negotiated a deal with NVIDIA CEO Jensen Huang that AI chip exports to China, 25% of that revenue would be given to the United States government. Now, if this was an export tariff, that is explicitly banned in the United States Constitution, which says that there will be no tariffs or taxes on exports. So how do you have a deal that does something that arguably is illegal under the Constitution? Well, it appears that we got the answer in the form of this BIS rule, which is saying that all of the chips exported to China are going to undergo a security review by the United States federal government. So they're not just going to say, NVIDIA, you say that these are the chips that you're allowed to sell. They're going to check that these are the chips that they're allowed to sell. And that is a service being provided by the United States federal government, the check. and you can charge for services that you provide, even when they're two private sector entities. And so if I had to guess how this is all going to be implemented, it's going to be, NVIDIA is going to be charged 25% of the cost of the product as a fee for service in doing that service of the check. So this is what I mean when it says like, how are these things going to be legal? And it really is like that. I mean, you are sometimes in the government and you are told from on high, this is what we're going to do. find the legal authorities that would enable me to be able to do this. So that's what's going on here. Now, the next big thing it does is put in place a lot of restrictions on under what circumstances the chips can be sold, how many of the chips can be sold. It's pretty clear to me that what they're trying to do is to some kind of extent, thread the needle between the national security concerns that so many folks in Washington, D.C. and around the world have raised about these chip exports. And then also the benefits, as the Trump administration sees them, both from the revenue that NVIDIA will receive from these sales, and also, as we've heard from the AI czar David Sachs, the purported benefits of getting China addicted to the American technology ecosystem. So How exactly is the Trump administration going to thread that needle? Well, they put it in this way. And I also want to send my compliments out there to Janet Egan and James Sanders over at the Center for a New American Security, who on January 16th published a really nice report that is a soup to nuts evaluation of this rule. So if you want to go into more depth that we're going to go on to this podcast, I certainly endorse your reading that report. And I'm going to quote from it liberally here in this podcast. So to begin, the rule caps total shipments to China at 50 percent of how many of each chip has already been bought for use in the United States. So what that means is you cannot sell all the H200 chips that you can only sell 50 percent of how many of those chips have already been sold in the United States for use by customers in the United States, which is interesting. And so CNAS actually took the step of saying, what does that suggest about how many chips China would be able to buy in the near time frame? They said, quote, China could purchase up to 850,000 H200 chips under this threshold. Combined with AMD's MI325X chips, China could acquire the equivalent aggregate compute of nearly 900,000 H200s. And what that means is that's an awful lot of chips, right? I think the largest AI computing facility on Earth right now is probably Grok's Colossus, which is now the Colossus 2 in process of becoming the Colossus 3. And I think they're pretty close to if they have not already exceeded 1 million chips in that computing supercluster. So what it means is that China as a country is certainly authorized to buy enough chips to build a state-of-the-art world-class computing facility. Now, and that's right away. And as more chips get sold in the United States, they can then sell more to China. So that number is not a static number that's going to continue going up as chip sales go up. One caveat there, of course, is that there's not just one company in China that would like to buy these chips. Alibaba wants to buy the chips. Baidu wants to buy the chips. Tencent wants to buy the chips. ByteDance wants to buy the chips and on and on. And so that those 900,000 H200s that could theoretically be sold would have to be divvied up amongst those companies unless NVIDIA basically picks a winner, which I think they're extremely unlikely to do and says all the chips get to go to one place. So what you really have is that the top companies in China are probably going to each be able to buy something like 100,000 to 150,000 to 200,000 chips apiece. Maybe some of them will be more excited to buy more. Some of them will be more excited to buy less. Now, the next thing is that there are certain provisions that NVIDIA or AMD or whoever the exporter is has to certify in order to be able to sell these. And one of them is clearly inspired by the GAIN-AI Act, which has since died in Congress. But you can see that some of the ideas from that debate live on because the rule states, according to the CNAS summary, quote, the rule requires exporters to certify China-bound shipments will not delay U.S. orders or divert foundry capacity from the domestic market. That is very much inspired by Gain AI, which, as you all will remember, gave U.S. companies sort of a right of first refusal. Now, what's interesting is it doesn't give the U.S. customers the right of first refusal. It just says that NVIDIA has to certify that it's not selling these chips to any Chinese customers when they would have been bought by U.S. customers. And that kind of makes me wonder, like, how loud are U.S. customers willing to be in terms of complaining that Chinese companies are getting chips that they would like to buy? I think that is really a political decision because Trump clearly wants to allow these chip sales. So is a company like Microsoft or Google or OpenAI, are they going to say, hey, those are my chips that I would love to buy that you're shipping to China? NVIDIA's certification was deceptive or in error. I don't know if they're willing to get that political, but this at least does give them that opening. NVIDIA has said that there is no tradeoff, so I don't expect them to have any reluctance in certifying this. The question is then, is it going to be contested? Is our U.S. companies going to get loud? Is the U.S. Department of Commerce going to put any question mark on those kinds of certifications? The second thing is this third party review, which we already talked about. So here again, I'm quoting from the CNAS summary. The new policy requires AI chips to undergo a third party review by a U.S.-based testing facility before export. This serves a dual purpose. It creates an independent verification layer that confirms technical capabilities match the license application, and it might plausibly be functioned as a workaround to constitutional restrictions on export tariffs. There's one other thing that I think they might be doing here, which I think is – sorry, that I think they might be doing here, that Chinese commentators have speculated they might be doing here. There has been some commentary on Chinese social media that this is actually a ploy to put spyware or malware in the chips by, for example, the National Security Agency. So effectively, we're going to put these sort of poisoned chips into the Chinese ecosystem and that this is all an elaborate trap to set back China's AI race. That is something that the United States government did do at times during the Cold War is selling known defective or worse than defective parts intentionally to the Soviet Union. I don't think there's been any credible reporting that that's actually what's going on here. But if it was what's going on here, would there necessarily be any credible reporting? I don't know. But I think it's interesting that China is concerned about this step in the equation and might factor into their decision about whether or not to buy the chips at all. Now, I think the next thing that we need to say is a quote from our friend of the podcast, Chris McGuire, who over at the Council on Foreign Relations has written a, I think it's fair to say, pretty strident criticism of the new policy. The title says a lot, quote, the new AI chip export policy to China, strategically incoherent and unenforceable. So here's one quote that I think elucidates his basic criticism. from using these chips. And when he says that, you know, this will not stop China's military or intelligence services from using these chips and that they're not enforceable, I think he's referring to the end user requirements that exist in these chips because you're allowed to sell chips to China, but you're not allowed to sell them to the Chinese military or to the Chinese intelligence services. And how does that actually get implemented? Quote, the rule requires exporters to certify that chips will not be accessed by prohibited end users, including military linked and blacklisted entities. But here's the thing. The U.S. Department of Commerce during the Biden administration specifically said that they were taking a China-wide prohibition on the exports of these chips because they had assessed prior end-user-based restrictions on chip sales and found that they were completely ineffective in stopping them from getting to the PLA or the intelligence services. So that's the thing. So how do they say that they're going to enforce the end-user restrictions? That's the thing. They're going to require that NVIDIA certify, the exporter certify, that they are selling them to a company that is not part of the defense intelligence apparatus and also that the customer understands and agrees not to resell the chips or use of the chips to a military intelligence customer. And is there any incentive for NVIDIA to actually do that? What are your thoughts on that? So I think if they were found to knowingly be selling to customers that had military intelligence ties, they would be subject to criminal penalties and executives involved would also be subject to criminal penalties. But I think the criticism here, at least the criticism from the Biden administration about the prior regime of end use checks, and these are criticisms that have been echoed by folks like Marco Rubio, who's now in the second Trump administration, is essentially it's not that NVIDIA is selling to company A, which they specifically know is a front company for the People's Liberation Army. It's just that they know that Chinese companies are perfectly willing to lie to NVIDIA and that NVIDIA or other companies do not have a credible mechanism for assessing which ones of their customers are or are not willing to transfer chips to the Chinese military. So that's what I think folks like Chris McGuire mean when they accuse this of being unenforceable. Sure, that makes sense. So what have other experts had to say since this rule was published on January 13th? Well, I think there's a few things that are worth saying. First is a quote that comes from Anthropic CEO Dario Amadai, who I think there was folks who know that Dario has been very sorry. Dario Amadai pronounced his name incorrectly, as I often do on this podcast. My apologies. But Dario has been very loudly opposed to these export controls for a very long time But something interesting happened in recent months which is that Anthropic received a financial investment from NVIDIA and Microsoft and appeared in a joint video with NVIDIA CEO Jensen Huang And so I think there was folks who were asking themselves, is Amadei going to walk back his criticisms of NVIDIA selling chips to China in the wake of that financial investment? And on January 20th at the Davos World Economic Forum conference, we got an answer to that question. And here's the quote from Dario. Quote, it would be a big mistake to ship these chips. I think this is crazy. It's a bit like selling nuclear weapons to North Korea. And so I tip my cap to Dario, who is not moderating his sentiments one iota in the face of what is arguably financial or political pressure. He still thinks this is a mistake. And he's basically saying, look, maybe we're going to do it, but we haven't done it yet. So don't ship the chips. Kudos to him. I think there's another quote that I want to highlight, which comes from a conference in China on January 10th, 2026. This was their AGI Next Frontier Summit. And interestingly, they got together four of the leading lights of China's AI ecosystem, representing multiple companies who are leaders in AI. and the full transcript of this panel was made available by the Geopolitics Substack, which published a full English translation. So kudos to them and thanks to them for doing so. And I want to highlight a quote from Lin Junyang, who was the tech lead behind Alibaba's Quen model. So this is one of the best open source models in the entire world, arguably the best open source model in the world. This is a smart person. And when Lin was asked, how likely do you think a Chinese company will lead globally in the next three to five years? His response was looking at the U.S.-China gap, and he said the following. This is a long quote, but I think it's worth reading. Quote, U.S. compute is one to two orders of magnitude ahead. But more critically, OpenAI and others are putting massive compute into next-gen research. Here, we're barely keeping up with daily delivery, which already exhausts most of our compute. This creates the contrast between rich people innovation and poor people innovation. Rich labs can waste GPUs. Poor labs, out of necessity, are forced to tightly optimize algorithms and infrastructure, things rich labs don't always have the incentive to do. And then he goes on and he says, if I had to assign a number, 20%. And I consider that optimistic because the historical head start is real. So he's saying that once again, you know, this compute gap between the United States and China is a key pain point for a company like Alibaba. They're barely able to keep up with their inference demands and that he sees only a 20 percent chance of China surpassing the United States in terms of having the best overall models over the next three to five years. And he thinks that's optimistic. I think that tells you a lot. And I want to underscore one part of the argument that he's making, which is how having a compute advantage reinforces an innovation advantage. And that is simply because when you're trying to make better AI algorithms, well, you need to run experiments. You need to have a hypothesis. Oh, maybe if I did this, it would make my algorithm better. And then I could, you know, ring more intelligence out of each unit of data input or computing resource input. But you have to have a hypothesis and then you have to run experiments to test that hypothesis. And those experiments are themselves computationally intensive. And so what he's pointing out is that companies like Alibaba, Chinese companies, are limited in the amount of computing resources they have because of these export controls. And that actually dampens their ability to be innovative and to develop the next generation of awesome algorithms because they can run fewer experiments because they're so bogged down just trying to serve their inference requirements. Now, he also points out that they have this incentive to focus on algorithmic innovation because they can't afford to waste GPUs, as he puts it. So it's not all bad, but it is almost all bad. And I think that's just one more quote that we have from this just laundry list of executives from Tencent, from DeepSeek, from Alibaba, from other leading Chinese companies that, boy, these export controls hurt and they wish they could buy all the NVIDIA chips that they want and need. So there you have it. There's two really interesting AI leaders around the world in different ways making the case for export controls on AI chips. So that's kind of where we are right now. Great. So now that we've broken down what this rule actually is, let's talk about China's response to this rule. So we heard about Beijing's decision to block the H-200s from entering China, at least for now. So can you break down this decision more for us? Yes. So this is happening in the very recent past. So we've got two high quality reports on this topic. The first is from Reuters on January 14th, which said, quote, Chinese customs authorities told customs agents this week that NVIDIA's H200 artificial intelligence chips are not permitted to enter China. Chinese government officials also summoned domestic technology companies to meetings on Tuesday where they were explicitly instructed not to purchase the chips unless necessary, which I think is an interesting little addendum there. Then on January 16th, there was a report in the Financial Times and the article was titled NVIDIA suppliers halt H200 output after China blocks chip shipments. So there's a lot of interesting stuff in there. Earlier reporting had suggested that NVIDIA was requiring Chinese customers to pay in full in advance before they would ship the chips, which is not a norm necessarily in the industry where it is either some amount of money up front, cash on delivery, that sort of transaction is more typical. And so requiring the Chinese customers to pay fully up front, I think, reflects NVIDIA's uncertainty as to whether or not they're going to get hurt again. Because remember, NVIDIA had said that they took a $5 billion write-off on the H20 work-in-progress inventory that they were not allowed to ship to China. So where does that leave us overall? I think it goes back to stuff that I've said earlier on this podcast, which is there are multiple constituencies in China and they have different preferences and they have different incentives. You have the Alibaba, Tencent, Baidu, DeepSeek, the AI leaders of China, the hyperscale cloud companies of China. It's pretty clear, unambiguously, they want to be able to buy NVIDIA chips right now. They would love to buy a huge, huge number of these chips. But then you have the companies like Huawei, SMIC, the people who are trying to create the alternative ecosystem to NVIDIA in China. and they mostly care about what's good for them. They mostly don't care about what's good for China. And what's good for them is banning NVIDIA, right? Because that gives them a captive market and near-term revenue. And it also encourages the important and powerful customers of China to invest in them, both from a buying their product thing, but also more importantly, perhaps, is building applications that leverage their software ecosystem, et cetera. etc. So that is what Huawei wants. And the Chinese government is in the middle to adjudicate between these two constituencies. And so we don't know where China is ultimately going to come down. It is clearly the case that, at least for right now, they're saying, no, you can't buy these H200 chips, quote unquote, unless necessary. And what exactly that means, I don't know. One interpretation of this behavior of blocking the chips of customs is the idea that this is continuing to negotiate, right? So when China blocked the imports of the H20s, that could be seen as a bargaining maneuver where they basically said, we're not going to accept these lower quality chips. And that successfully persuaded the Trump administration to, quote unquote, up the ante and offer H200s, a much more attractive chip from a financial return on investment per capability basis. So one interpretation is that China is just doing that again, right? That they are refusing to allow these H200s into the country in the hopes that America will once again up the ante and not sell just H200s, but also the Blackwells and ultimately the Vera Rubin. And I want to say that NVIDIA has claimed that the Verirubin next generation chip is going to, on a performance per dollar basis for AI applications, going to be something like 10 times better than the Blackwells, which were already considerably better than the H200s. So China might be saying, hey, you need to make us a real offer here. And all we're going to accept is the latest and greatest stuff. It could also be a negotiating strategy around these restrictions for the H200s, which, you know, as the CNAS analysis points out, only allows around 900,000 H200 equivalents in the near term, at least. And so they could be saying, you know, we don't want it if you're only going to sell us 900,000. We would want it if you're going to sell us like 5 million. And that's actually enough to move the needle, right, so that we can build five AI companies at the frontier or whatever. So that's one interpretation of events. Another interpretation of events would be that Huawei is just winning the argument domestically, right? And I think that's plausible. It's certainly consistent, right, with the customs blocking the maneuvers. And Xi Jinping was pro self-reliance when America was willing to sell everything to China in terms of it. I mean, that was reflected in Made in China 2025 back in 2015. Right. That was a path to self-sufficiency. And that was, you know, China's first salvo. And it was not in response to some American provocation. That was just what they wanted as their policy. So and then the final thing I think could be that it's not just that China agrees with Huawei and SMIC and the argument they're making, but that the Chinese government is like being fooled by Huawei and SMIC. And so you could actually interpret, and again, I'm speculating here, but you could interpret remarks like those of the Alibaba executive as trying to basically say, hey, Xi Jinping, we know Huawei is telling you that they can cover all of China's domestic needs like immediately, but they're lying to you. Like they can't do that. Like we actually are suffering. We need you to help us out here and allow us to buy more of these NVIDIA chips. So, like, that's the question. If it is indeed the case that China's government is agreeing with the Huawei faction, are they agreeing because they know the painful tradeoffs and they accept that pain? Or are they agreeing with Huawei because they're being misled by Huawei and they don't even recognize that this tradeoff exists? So, Greg, what do other experts in the field suggest as other reasons that China might be blocking the imports of H200 chips? Well, I think the interpretations that I've given are the main ones that are out there. But I do want to give credit to another friend of the podcast, Leonard Heim, who we've had on here before. And he posted on X about China, quote, they don't have an accurate picture of their own AI chip production capabilities. They've invested billions. Of course, they think the fabs are working. I bet SMIC and Huawei have a hard time telling them what's going on. So that's a that's sort of an elocution of the ignorance theory of China's decision making. There's one other post on X from Sam Hammond, which is pretty funny. So I have to read it because it's pretty good. So he said, quote, we're being saved from the mistakes of boomer U.S. politicians with unrealistically long AGI timelines by the mistakes of boomer Chinese policymakers with unrealistically long AGI timelines. I thought that was pretty funny. One thing, just because this is like the only podcast audience where I need to make this distinction. But when he says boomer, he means as in baby boomer, as in old people, not as in boomer versus doomer, you know, AI optimist versus AI pessimist. He's basically saying, you know, that both folks think that AI is going to be transformative over a longer time horizon than is real. And as he said, we're being saved from the mistakes of our side by the mistakes of their side, which I thought was a was a funny way of characterizing it. That is a good way to wrap up the section of the podcast, too. And I'm sure that we will be talking about export controls many more times in the near future. So stay tuned. But for now, let's transition to talk about the Pentagon's AI strategy. So on January 9th, the Pentagon published its artificial intelligence strategy for the Department of War, which Secretary Pete Hegseth had distributed to senior Pentagon leadership. So to start us off, could you give us an overview of what this memo includes? Well first I have to just remind folks that when I was in the government my final job before I left was director of strategy and policy at the Joint Artificial Intelligence Center And so I had inherited one DOD AI strategy I had drafted the white paper that we submitted to the National Defense Strategy authoring folks for what should the updated AI strategy be. This was all years ago, of course. So you can imagine I was deeply, deeply interested in this document called the New Artificial Intelligence Strategy for the Department of War. It's sort of the direct air to work streams that I was deeply involved in and at times led when I was in the Department of Defense. So this is a short document. It's only six pages long. And it is, to put it mildly, bullish on the opportunities that AI presents to the Department of War. It really says that AI is absolutely critical to the future of military power and that the Department of War needs to have a, quote, wartime footing and mindset in adopting artificial intelligence as fast as possible. And, you know, strategy documents like this, I want to emphasize, sometimes matter a lot and sometimes are completely irrelevant. And the amount of attention that they get in the press doesn't necessarily tell you how much they're going to matter. One other thing that I think is worth pointing out here is that there is a classified annex to this document. It is referenced in the unclassified version. It talks about the classified annex. And so all that we're going to be discussing on this podcast is in the unclassified version of the memo. It is possible that what is in the classified annex is, you know, just reiterating most of this stuff with a little more spice and flair and specific relevance to classified activities. It is possible that it is a much more substantial and direct document and that like most of what matters is in the classified annex. I am not privy to which of those scenarios is true. I'm just sort of telling you like how the relationship between classified and unclassified strategies sometimes work in the DoD. I will say that I once met a senior leader in the Department of Defense who did matter for AI stuff in the Department of Defense, who was completely unaware that there was a classified annex to the first Department of Defense AI strategy. And so like that that shows you right that like for a strategy to matter, people have to know about it, to read it and to feel accountable to it. And I think there's a lot of mechanisms in this document and processes that it sets in motion that, to me, basically guarantee this is going to be a quite significant document. I mean, to put it mildly, there's a lot of threats in this document to people inside the Department of War who do not get with the program on adopting AI as fast as possible. Let me give you just one example of one of those threats. Here we go. So on the section titled AI Native Warfighting, it says, we must put aside, sorry, this is a quote, we must put aside legacy approaches to combat and ensure we use this disruptive technology to compound the lethality of our military. Exercises and experiments that do not meaningfully incorporate AI and autonomous capabilities will be reviewed by the Director of Cost Assessment and Program Evaluation for Resourcing Adjustment. Now, for anybody who doesn't understand DOD bureaucratic language, reviewed by the Director of Cost Assessment and Program Evaluation for Resourcing Adjustment means… Are they getting rid of you? Yeah. Those are the people who cut your budget. They basically say like, you stink, your program stinks, we're going to cut your budget. And it's our job to write like the reasons for why your budget gets cut. So he's saying exercises and experiments that are not using AI enough, that are not using autonomy enough, you're going to be put on the naughty kids list for a budget cut. So I promise you, everybody who runs exercises in the Department of War is now saying, oh, gosh, how am I going to put AI into my exercises in a meaningful way? I do not want to be on the chopping block for that kind of a reason. There's other stuff that's in there that I think is really noteworthy. So one section titled Data Access gives new authorities to the chief digital and artificial intelligence officer. This office is the direct successor to the Joint Artificial Intelligence Center where I worked. It was formed out of a merger with the JAIC and a few other organizations. And the section here is really interesting because it says that the CDAO can demand access to data sets from anyone in the Department of War, effectively, as long as they hold the relevant security clearances for the data. And it says that the people who have those, well, actually, let me just read the whole quote. Quote, military departments and components will establish, maintain, and update federated data catalogs, exposing their system interfaces, data assets, and access mechanisms across all classification levels as mandated by the department's May 2021 memorandum, Creating Data Advantage. They will deliver their current catalogs with all available updates to the CDAO within 30 days of the date of this memorandum. The Undersecretary of War for Intelligence and Security will ensure intelligence data receives parallel treatment with exploitation pathways established within the same timeframe. The CDAO is authorized to direct release of any DOW data to cleared users with valid purpose consistent with security guidelines. Effective immediately, denials of CDAO data requests must be justified to the Undersecretary of War for Research and Engineering within seven days, who will remediate or escalate to the Deputy Secretary. What does that mean? It basically says, hey, every single agency in the Department of War, you have to go inside and figure out like what data you have and you have to publish it in this catalog that basically says what we have, what it might be useful for and how to get access to it. And if the CDAO ever asks you for access to it and you don't give it to them within, yeah, within seven days, they get to go to the Undersecretary of Defense for Research and Engineering, which is one of the, you know, probably five, six most powerful people in the Department of War, and basically say, you know, this is why we're not giving our data to the CDAO. And if the undersecretary of war for research and engineering doesn't like your explanation, then it gets kicked up to the deputy secretary of war who can overrule anybody in the entire department. So it basically says, say yes when the CDAO asks you for your data. And if you say no, they get to escalate very high in the food chain very fast to force you. And you're going to pick a fight that you're probably going to lose unless you have very, very, very good reasons. Now, when I was in the DOD, this was a huge pain point for us, right? No data, no AI. So if you have an awesome idea for how you can use AI to, for example, analyze satellite reconnaissance photographs, well, if you don't have a huge, awesome database of satellite reconnaissance photographs, you're definitely not creating an awesome AI associated with that capability. So, you know, we had to go beg, plead and, you know, try and get access to the data sets that mattered to us. And sometimes people told us yes. Sometimes people told us no. Sometimes people told us yes, but didn't like didn't make good on their yes. And, you know, we had to come crawling to the chief information officer who was, you know, powerful, but not like super duper powerful, certainly not as powerful as like the secretary of the army. And it was just not, you know, a fun thing being told no over and over and over again. This memo basically says, I expect the CDAO to get the data they need. I expect them to get it fast. I expect them to get it easily. and anybody who's not making it easy for them is, again, going to be on my naughty list, which, as I prove elsewhere in this memo, people who are on my naughty list... Not good. Yeah, suffer real consequences and punishments. So that's one big part of this on data access. There's another thing that is like really music to my ears just from like my pain and suffering, something that I lived when I was at the Department of Defense, something I've written about. since I have come to CIS, which is just all the blockers that make life hard when you are trying to do AI in the DoD. Data access is one of them. But another one is around like the authority to operate process, which is targeted at a real problem, which is when you put stuff on the DoD network, how do you know that it's cyber secure and not, you know, secretly includes a package of malware from Russia or China or wherever. So the authority to operate process is designed to say, like, anything that's going to touch the DoD network has to go through, you know, a 10,000 year review of all of its code to ensure that it's safe. And I think that process is truly awful. And on the one hand, it's targeted at a legitimate problem. But on the other hand, the cure is probably worse than the disease, and we need a different flavor of cure. And here's what the memo says about the blockers that you encounter that I've written about here at CSIS. So, quote, wartime approach to blockers. We must eliminate blockers to data sharing, authorizations to operate, test and evaluation and certification, contracting, hiring, and talent management, and other policies that inhibit rapid experimentation and fielding. We must approach risk tradeoffs, equities, and other subjective questions as if we were at war. To this end, I expect our CDAO to act as a wartime CDAO and to work with the Chief Information Officer to fully leverage statutory and delegated authorities to accelerate AI capability delivery, including cross-domain data access and rapid ATO reciprocity on behalf of pace-pushing leaders across the department. The Undersecretary of War for Research and Engineering will establish a monthly barrier removal board with authority to waive non-statutory requirements and escalate blockers for immediate resolution. That is so interesting to me because it basically means like the way that I've often described it is if you are trying to water your garden, right? You have a bunch of flowers that you would like to bloom of exciting little AI initiatives. Well, there's two ways you can get more water to your flowers. You can either crank up the water pressure or if there is a kink in your hose that is blocking water from getting into it, you can unkink the hose. And in the previous administrations, I think the overwhelming emphasis has been on increasing the water pressure, like more money, more staff. And I think here what they're really identifying in a direct way is that we need to unkink the hose. We need to identify what are all the things that make doing AI in the government so hard, so complicated, so slow, even beyond the difficulties of just AI technology, specifically what makes it hard when you're in the DoD context. We need to identify those blockers and we need to not, you know, just throw out any of the concerns that they raise. Right. Like the ATO process is raising very real cybersecurity concerns. Those have to be addressed somehow. But the somehow by which they are addressed cannot be worse. You know, the cure cannot be worse than the disease. And they're saying that that needs to be evaluated on a wartime footing, which I think is so interesting because what we've seen in the war in Ukraine, a lot of the progress that they've made on digitization, a lot of the progress that they've made on AI transformation. It's not like Ukrainian brains are 10 times larger than those in America. It's just that they're on a war footing and they have a very different approach to risk. And you can see that the CDAO and the Department of War as a whole is now being directed to treat it like they're in wartime and evaluate risk with that mindset, which I think, gosh, if that doesn't make stuff go faster, what will? Yeah, absolutely. So next, let's get into the details of the seven PSPs, which should be the most concrete outcome of this document. So can you first tell us what PSPs are, and then can you walk us through each of them? Yes. So this is what they call pace-setting projects, PSPs. And the way they're summarized is, quote, that will demonstrate the accelerated pace of execution, focus, and ethos we need to stay ahead. The PSPs will also serve as tangible, outcome-oriented vehicles for rapidly completing our build-out of the foundational AI enablers, infrastructure data models policies and talent needed to accelerate ai integration across the entire department so basically what they're saying is they've got these seven flagship projects uh worth noting um that the classified annex maybe what it does is it elaborates on these seven projects maybe what it does is it adds seven other projects right that are not discussed in this unclassified summary i have no way of knowing but uh in in the the seven projects as they're described here, it's pretty light in terms of what it says. So it names them. You've got Swarm Forge, Agent Network, Enders Foundry, Open Arsenal, Project Grant, GenAI.mil, and Enterprise Agents And they broken into these three buckets Warfighting Intelligence and enterprise So I talk about what we got here but what we got here is not a ton So Swarm Forge, this is all they say about it. Quote, competitive mechanism to iteratively discover, test, and scale novel ways of fighting with and against AI-enabled capabilities, combining America's elite warfighting units with elite technology innovators. What is that? I don't give you much there. Yeah. So I think there's a few things that stand out to me. Number one is swarm. When people say swarm in a military context, they usually mean swarming drone capabilities. And that could be aerial, that could be naval, that could be land. and then iteratively discover, test and scale novel ways of fighting with and against AI enabled capabilities. So that means like, what about our swarm versus their swarm? And then it also says combining America's elite warfighting units. You know, some people, when they say elite warfighting units, they mean special forces, right? The people who, you know, are the best shots and can run the fastest and blah, blah, blah, blah, blah. like Navy SEAL Team 6, right, means elite. And then other parts of the military would take offense to that characterization. And they're saying like, what, you mean like our best fighter squadrons are not elite because they're not special forces? And so we don't even know who is doing this swarm portrait. Could be referring to special forces, could be referring to anything else. All right, but it almost certainly means robotics, really, is what it means. Really, it's the actual systems that do stuff in warfighting. The next one is agent network. unleashing AI agent development and experimentation for AI enabled battle management and decision support from campaign planning to kill chain execution. So we hear agent network. I assume that they're using agent in the same way that it is used by most of the generative AI companies, which is we're talking like large language models type chat bot stuff, but they don't just chat with you, they actually take actions on your behalf to make you more efficient. And so what might that mean in campaign planning to kill chain execution and battle management and decision support? I assume it means that like, okay, we're not just going to be doing all of that stuff by clicking boxes and doing stuff. We might be able to tell an agent, go do something, of thing, and it will actually implement the various steps associated with that. Getting that reliable to the degree of reliability that is required for most things involved in the use of force, I'll tell you, I certainly don't think AI agents are there right now in terms of the reliability required. But this is the Department of War trying to figure out what the future looks like and get there as fast as possible. So they'll struggle with those reliability concerns and think about how to integrate agents into mission critical contexts. I think that's going to be a tough challenge. Enders Foundry. Accelerating AI-enabled simulation capabilities and SimDev and SimOps feedback loops to ensure we stay ahead of AI-enabled adversaries. Well, this is obviously all about simulation associated with warfighting, which I think if you think about how AI has mastered various types of games like chess, like Go, because the simulation of that game so closely resembles the reality of that game. Well, that's already coming, you know, to warfighting relevant capabilities. It was a few years ago that DARPA ran a grand challenge where an AI autopilot defeated really good fighter pilots from the U.S. Air Force in flight simulators. So the question is, what if you could expand that simulation from being a dogfighting type scenario to being like at a campaign level where we're simulating the whole thing? Well, maybe you could come up with new operational strategies and tactics, you know, developed through these simulations as executed by the AIs. Now, one challenge I want to point out here, anytime you're introducing these types of simulation capabilities is the degree of difference between your simulation and reality, especially if you're using reinforcement learning, which is a really popular machine learning paradigm when you're talking about these kinds of applications. any differences between your simulation and reality are probably going to be exploited by your AI system. And that might be and and similarly, any differences might prevent the system from discovering novel strategies. So what do I mean by that? Let's take the latter case first. If your simulation does not allow soldiers to get shovels and dig trenches, then your AI is never going to invent trench warfare. Right. So like the innovativeness of the AI is limited by the capabilities of the simulation environment. Um, the, the flip side of that is, um, if there are differences in reality, for example, like there are, uh, unrealistic degrees of accuracy that are possible in the simulation that maybe are not real world realistic, um, then the system might optimize for that. So example would be in the DARPA dogfighting simulation. Part of the reason why the AI fighter pilot was winning so reliably is that it had sort of become a perfect aimer of its guns. And so it could look at you head on and like bullseye you from very, very, very far away. Now, that's based on the physics of the simulation where he was able to run that experiment like a million times. And how close do the bullet accuracy, physics, error modeling, blah, blah, blah, blah, blah of that simulation resemble reality? If it's even at all a little bit imperfect, then maybe your aim bot when you deployed in the real world is like not going to be that accurate. And so if you have tactics that are based upon that being possible because the simulation told you it was possible, you're going to have a disaster when you meet the real world environment. So I'm like excited about this, but I'll just say, you know, there's a lot of stuff that makes doing this kind of simulation work hard. But it's definitely exciting enough that the Department of War should be exploring it. But I just like there's a lot of challenges associated with that kind of work. OK, number four, Open Arsenal, accelerating the tech into capability development pipeline, turning Intel into weapons in hours, not years. Gosh, I really struggle to know what the heck they're talking about there. My first guess would be something related to cybersecurity. But I don't know. When you turn Intel into weapons, it's hard for me to see, you know, how you would do that. It's not a cyber kind of a story, but maybe I'm missing something. Project Grant, number five, enabling transformation of deterrence from static postures and speculation to dynamic pressure with interpretable results. No idea what they're talking about there. Sounds interesting, though. Okay, number six, genai.mil. Democratizing AI experimentation and transformation across the department by putting America's world-leading AI models directly into the hands of our 3 million civilian and military personnel at all classification levels. I think this is pretty straightforward. This is office worker-type support from AI co-pilots with sort of state-of-the-art generative AI. That's something that the military has already been experimenting with, with NIPR, GPT, and other capabilities making these types of things available. They clearly state that they want to do that DOD-wide. And one other thing that is very interesting is that it explicitly says the goal in this strategy that they want them to be state-of-the-art models. They want the models that are used in the government to be no older than I think it's 30 days from whatever state of the art is in the commercial world. So if, you know, OpenAI releases GPT-6 tomorrow, then theoretically GPT-6 should be available on Department of War networks not later than 30 days. Boy, the cyber. That feels ambitious. Yeah, the cybersecurity certifications associated with doing that, I suspect, are going to be a formidable challenge, which hopefully will lead them to get a lot better at AI-based automatic verification of cybersecurity, which is something we should be investing in anyway. But anyway, that kind of dream of keeping everything state-of-the-art is commendable, but it's really tough to do that in a classified networking environment. Okay, Enterprise Agents. This is the seventh and last pace-setting project. Building the playbook for rapid and secure AI agent development and deployment to transform Enterprise workflows. I think it's just the exact same thing. So whereas number six is about putting LLM chatbots on every desk in the Department of War, Enterprise Agents is about as the commercial world moves towards agentic AI, the Department of War should do that the same. And I think, you know, we're in a world right now where agentic AI is already a very real capability that is delivering a lot of value to programmers and coders. And the expectation is that that's going to increasingly be the case for all manner of office work type jobs. And the Department of War wants to be, you know, on the front of that trend, not a laggard in that trend. So those are the seven PSPs. There's no stated budget for these projects, but it does seem like we should expect to see that in the president's budget request in the not too distant future. One other thing that I think is interesting is that all the services, so Army, Navy, Air Force, Marine Corps, Space Force, and all the components and all the agencies are directed to identify fast follow projects associated with these pace setting projects. projects. So the pay-stating projects are going to be handled at the Office of the Secretary of Defense level, presumably led in most cases by the CDAO. But these fast follow projects basically means like everybody across the Department of War, you need to explain how you're also trying to do this thing that is being led by the presumably CDAO. Wow. You know, that's quite a directive, right? Like even the janitorial people have to figure out, right, how they're going to use agentic AI. That's pretty interesting stuff. Yeah. And so I'm interested to hear based on your experience at the Jake and after you have analyzed this new strategy, how does this strategy compare to past AI plans that the Pentagon has released? Well, it's unambiguously more bold. It's unambiguously more forceful. It unambiguously views the situation as more urgent and higher priority and important. I mean, when I was in the Department of Defense and even before I was in the Department of Defense, AI was a trendy topic. It got a lot of media attention. When senior leaders in the DOD would testify before Congress, they were often asked about it. But inside the department where there's a lot of, you know, sort of calcified bureaucratic resistance to, you know, doing anything that isn't exactly what I hoped to be doing today, we encountered a ton of resistance. And you can definitely tell the frustration that people like I experienced and my successors have experienced. This memo is designed to take a bazooka to the challenges that we faced. and to make life hard for anybody who wants to slow those people down in the Department of Defense. So that's really interesting. I do think we're going to have to wait until we see what the funding story is, especially for these pace-setting projects. The Department of War can do some stuff right away using what's called reprogramming authority, which basically means you can move money from bucket A to bucket B, assuming the congressional committees bless that kind of activity and they can just write a letter blessing it. They don't have to pass a law. But there's limits as to how big your reprogramming authority budgets can be. What this document says is vague but meaningful. Quote, the means we will employ to pursue this strategy will continue to encompass our substantial program funding and workforce focused on AI across the services and components. We will also use the timely financial resources provided by Congress in the form of one big, beautiful bill, along with expanded budget withhold joint acceleration reserve flexibility to catalyze our accelerated pace of military AI integration in the immediate term. What does that mean? It means that they're going to tell people they have to do it within their existing budget authorities in most cases, I think. And then at some point, they're going to try and figure out how to get more money, presumably from Congress in the not too distant future. Well, I guess we'll find out and we'll keep talking about it on this podcast. But I think that does it for today, Greg. So thanks, as always, for breaking down those two big news stories for us. Yeah, thanks. It was a big, big week for me. Two topics I'm very passionate about. Yeah, well, I really enjoyed it and found it really helpful. Hopefully the listeners did, too. And can't wait to chat more on a news roundup in the future. But thanks so much. Thank you, Sadie. Thanks for listening to this episode of the AI Policy Podcast. If you like what you heard, there's an easy way for you to help us. Please give us a five-star review on your favorite podcast platform and subscribe and tell your friends. It really helps when you spread the word. This podcast was produced by Sarah Baker, Sadie McCullough, and Matt Mann. See you next time.