Making Sense with Sam Harris

#463 — Privatizing the Apocalypse

22 min
Mar 11, 20263 months ago
Listen to Episode
Summary

Rob Reed discusses the Deep Vision project, a USAID-funded biosecurity initiative that aimed to discover 10,000 novel viruses, characterize their pandemic potential, and publish their genomes globally. Reed details how a cross-partisan coalition successfully pressured the U.S. government to defang and ultimately kill the program, which posed catastrophic risks through potential lab leaks or malicious use.

Insights
  • Well-intentioned biosecurity programs can inadvertently create civilization-scale risks by concentrating dangerous pathogen knowledge in accessible formats without corresponding safety infrastructure
  • Effective policy intervention on existential risks requires cross-partisan coalitions and leveraging multiple pressure points (Capitol Hill, administration, civil society) rather than single-channel advocacy
  • The number of entities capable of conceiving and implementing programs with Deep Vision's destructive potential is remarkably small, but this advantage erodes rapidly as AI and synthetic biology democratize capabilities
  • Current biosecurity frameworks fail to account for the distinction between discovering dangerous pathogens and the inability to productively act on that knowledge (e.g., vaccine development without human trials)
  • AI advancement will exponentially increase the number of actors capable of weaponizing biological information, making current governance models obsolete within years
Trends
Biosecurity governance lag: Policy frameworks designed for pre-AI biology are becoming dangerously misaligned with technological capabilitiesCross-partisan biosecurity coalitions: Existential risk issues transcend traditional political divides and attract unlikely allies (Lindsey Graham, Rand Paul, Chelsea Clinton)Synthetic biology democratization: Reverse genetics and viral rescue techniques are becoming accessible to thousands globally, expanding potential bad actors from dozens to millionsPathogen discovery vs. utility gap: Identifying dangerous viruses without actionable countermeasures creates pure downside risk with no corresponding benefitAI-accelerated dual-use research: Generative AI will compress timelines for weaponizing published pathogen genomes, making information security the new biosecurity frontierUSAID biosecurity mission creep: Development agencies are expanding into high-risk research domains without adequate existential risk assessment frameworksLab leak probability normalization: Institutional acceptance that all biosafety levels demonstrably leak, yet continued operation of leak-prone facilities with dangerous pathogensUnvetted global pathogen access: Publishing viral genomes to 30,000+ people globally with no vetting mechanism for malicious intent or capabilityCivilization-scale pandemic scenarios: Multi-pathogen simultaneous emergence could collapse supply chains and essential services faster than single-pathogen scenarios like COVID
Topics
Deep Vision Project (USAID biosecurity initiative)Synthetic Biology and Dual-Use ResearchPandemic Risk and Biosecurity GovernanceVirus Hunting and Pathogen Discovery ProgramsBiosafety Level (BSL) Laboratory Standards and LeaksReverse Genetics and Viral Rescue TechniquesAI-Enabled Biological WeaponizationExistential Risk Policy AdvocacyCross-Partisan Coalition Building for Risk MitigationWuhan Institute of Virology (WIV) Coronavirus ResearchUSAID Predict ProgramVaccine Development for Novel PathogensInformation Security in BiosecuritySupply Chain Collapse ScenariosMalicious Actor Capability Assessment
Companies
USAID
U.S. government agency that authorized and funded the Deep Vision project with $125M budget before it was killed.
Wuhan Institute of Virology
Chinese research institution conducting long-term coronavirus collection and characterization work similar to Deep Vi...
Helina
Problem-solving organization that identified global biosecurity risks and convened experts to address Deep Vision thr...
TED
Conference platform where Rob Reed delivered talk on biosecurity risks that led to White House engagement.
People
Rob Reed
Venture capitalist and biosecurity expert who led whistleblowing effort against Deep Vision project.
Sam Harris
Podcast host who collaborated with Reed on Deep Vision episode and provided platform for advocacy.
Kevin S. Felt
MIT evolutionary engineer deeply involved in Deep Vision project who testified about its risks.
Samantha Power
USAID director targeted as key decision-maker to halt Deep Vision program (distracted by Ukraine crisis).
Daniel Schmachtenberger
Existential risk expert who curated 12-13 hour brainstorm session and mobilized Washington network against Deep Vision.
Tristan Harris
Technology ethicist who participated in brainstorm session that led to Deep Vision coalition building.
Lindsey Graham
U.S. Senator who independently discovered Deep Vision and sent letters to USAID expressing concerns.
James Risch
U.S. Senator from Idaho who co-led Capitol Hill pressure campaign against Deep Vision.
Rand Paul
U.S. Senator who held hearing in summer 2022 where Kevin Felt testified about Deep Vision risks.
Chelsea Clinton
Public health advocate with MPH who leveraged network to pressure USAID on Deep Vision concerns.
Prodig Basu
Helina staff member who identified sympathetic senators and built cross-partisan coalition against Deep Vision.
Chris Anderson
TED curator and venture capital partner with Rob Reed in resilience-focused investment fund.
Naval Ravikant
Entrepreneur interviewed by Reed on biosecurity risks before TED talk that sparked White House interest.
Quotes
"It had, in a worst case, the potential to cancel civilization, is how it was put to me. And with the best of intentions."
Rob ReedEarly in episode
"An isolated bat cave that nobody is otherwise ever going to enter is a much better safer place for a pandemic grade pathogen, then a lab that's staffed by imperfect humans."
Rob ReedMid-episode
"You were potentially giving the killing power of a nuclear arsenal to 30,000 completely unvetted strangers throughout the world."
Rob ReedMid-episode
"Imagine seven pathogens emerging all at once from 20 different airports, you know, a complete worst case scenario. I don't know how we survive that."
Rob ReedLate episode
"Somehow a very, very, very tiny population of well placed, highly placed do-goaters came up with this idea. So that is a very powerful and grounding lens through which to look at a coming era, a near-term era, in which untold thousands of people will be empowered to have ideas as bad as the vision and worse."
Rob ReedEnd of episode
Full Transcript
Welcome to the Making Sense Podcast. This is Sam Harris. Just a note to say that if you're hearing this, you're not currently on our subscriber feed, and we'll only be hearing the first part of this conversation. In order to access full episodes of the Making Sense Podcast, you'll need to subscribe at samherris.org. We don't run ads on the podcast, and therefore it's made possible entirely through the support of our subscribers. So if you enjoy what we're doing here, please consider becoming one. Okay, Rob Reed. Thanks for coming back on the podcast. It's good to be back. So we've done, yeah, you probably have a better count of the number of podcasts we've done on this topic than I do. I mean, we did one that was a very deep dive that was, you know, more highly produced, where it was almost like your audio book framed by our podcast conversation. We share this concern around biosecurity and pandemic risk and bioterrorism, and you have an update for us on the fate of the deep vision project. Yes. But before we jump into that, just remind people how you got to this topic. What do you, how did you come to be focused on this and how much of your bandwidth has taken? Yeah, well, my full-time job is in venture capital. I run a fund that invests in companies that we think will make the world more resilient in some important way. Fabulous job. I do it with gentlemen, you know, very well, Chris Anderson of Ted Fame. Yeah. So that's my full-time job. In this case, I have been, I guess my public service, you know, side of life, voluntary side of life has been focused entirely on bioresque for about a decade. It started when I was writing a sci-fi novel called After On, and that had a subplot in it about a nihilistic kind of cult that thought it would please God tremendously if they killed every person on Earth. It wasn't the center of the book. And so they use synthetic biology, which I'll abbreviate to send biologists to make, you know, save us some syllables. To come up with an omnisciedal pathogen that could hopefully do that. And that started me worrying about this particular category of risk. And you give a TED talk about it. Yeah. That came, that was a couple of dominos later. So I started worrying about this category of risk. I interviewed scientists in order to write this book accurately. And then I started a podcast called After On, same title, and I explored the topic there, including an interview with a brilliant person that I'm sure a lot of your listeners know, I'm Naval Ravik Kant. We talked about that, and that was about 10 days before the TED conference. So TED folks called me up, said, would you like to do a talk about this? Usually people have, you said, a month or a day. More than 10 days? Yeah, more than 10. But it went well. And you first entered the picture at that point because you were at TED, you came up to me and said, hey, we should do something ambitious on this important topic. It's podcasters, maybe team up. And then along comes COVID a few months later. And I really rabbit hold into the topics of synbios, risk, and pandemic resilience. And you and I did end up doing that magnificently sprawling almost four hour episode on the subject. That traveled far and wide. And eventually somebody from the White House reached out to me, White House staff, and said, would you like to come in and present to some pretty senior people in biosecurity? So I did that and went to Washington. And it was through that I learned about this crazy program called Deep Vision, which had just been authorized. It was growing up inside of USAID of all places. It had a $125 million five-year budget. And in the words of one very wise person in the field of biosecurity, it had, in a worst case, the potential to cancel civilization, is how it was put to me. And with the best of intentions. With the best of, we actually literally with the best of intentions, but what a terrible thing to do, right? So I learned about it and decided that that may not have been an exaggeration and decided to do my best to blow the whistle on it. So I actually called you at that point and I told you what was going on. And I told you that I thought the best way to blow the whistle on this would be to have a really extensive interview with a professor at MIT named Kevin S. Felt, who's, I would characterize him, I think, as an evolutionary engineer. And he was very, very deep in this program. And you made the suggestion, which was an excellent one, that I should interview Kevin because I was pretty deep in the subject already. And that we could both, I created an episode of my podcast, which we could both then broadcast to our audiences with yours being much, much larger in hopes that somebody would, would hear it and, you know, help, help to do something. So we did just that, you and I. And it was, it was actually, you might remember, I'm sure you remember this, you and I had an audience of one in mind, which gave us optimism that this might work, which was Samantha Power. She was running USAID at the time. And I think her husband had just been on your podcast and I had a couple of people in common with her, but unhappy accident of history. I think just days before we posted this episode, the Ukraine invasion happened and USAID was very busy there. It was actually a couple of months of crickets, but then things started to happen. Yeah. Yeah. So let's remind people, first of all, that deep dive is still in our podcast feeds to be listened to should anyone want to hear it because we go into just the larger set of concerns around, you know, send bio and pandemic risk. But let's focus on deep vision. What was deep vision and what happened to it? It was three really bad ideas, arguably each one worse than the one that came before. So deep vision was going to do three things. The first one is called virus hunting and virus hunting basically in this context was going to involve going out to a dozen developing countries where they're going to be doing business. I think they wanted five in Africa, five in Asia, two in Latin America and going to very remote places like bush meat markets, isolated.caves was going to be a very, very big one. And tried to discover roughly 10,000 undiscovered viruses of unknown deadliness and extract them from these remote places and bring them into very leaky imperfect vessels in dense population centers called laboratories. And I categorize laboratories that way because every category of laboratory all the way up to the highest biosecurity level, demonstrably leaks. There's plenty of history that shows that. And the alarming thing is we do not know the rate at which they leak because there is no uniform reporting system, et cetera. We just know that they do and they in some cases leak predictably, which means that an isolated bat cave that nobody is otherwise ever going to enter is a much better safer place for a pandemic grade pathogen, then a lab that's staffed by imperfect humans. So this has been a long standing practice though. The virus hunting was a thing I remember before I ever heard of deep vision or this specific project. And it seemed a sensible practice on its face. I mean, it wasn't obvious what was wrong with it and probably still isn't obvious to many virologists who are incentivized to not recognize that it's a problem. What is the stated motive for going into caves and sampling from the the viral of bats and bringing that out into the open? Well, I'll tie to the next school of deep vision, which is, was going to be characterization, which is a series of four experiments that would determine which of these viruses were most likely to be true weapons of mass destruction, most likely to be pandemic grade viruses. Why would you do those two things? In theory, it seems to make great sense that you would want to find out what the pandemic grade viruses are and where they're living. So you can start monitoring the interfaces between the human population and where those viruses are living. The fact is you can do that kind of monitoring very, very robustly with traditional public health methods. And the danger that happens is if you find these viruses, you extract them, you bring them into places into lab, you know, leak prone laboratories. And then you do this characterization work and you find out like, wow, these are profoundly deadly things. There's not a lot you can actually do with that. You can't make a vaccine, for instance, because the way that we know if vaccines work is we wait for there to be an outbreak where we start inoculating people and discovering whether the inoculated people are healthier than the uninoculated people. If you did this hypothetical act and you found a deadly virus and you determined that it was really, really dangerous, quite possibly a pandemic virus, you might come up with a vaccine candidate, but you're not going to have any knowledge of safety or efficacy. And because you're not going to infect a bunch of healthy volunteers with a potentially deadly virus in hopes that the half of them who get are not in the control arm and get the vaccine, maybe the vaccine works, it doesn't work. You will have the vaccine candidate. And so that's not useful knowledge. And it's actually very, very damaging knowledge because if it becomes widely known that this pathogen might be a real doozy, it's going to become the most famous pathogen on the planet or one of them. And the next thing you know, maybe dozens or even hundreds of laboratories are studying it in BSL2 or BSL3 labs because it wouldn't be in a BSL4 and these are the gradations of biosucurity because it's of unknown deadliness and that tends to push it to BSL2 or 3. And so now you potentially have this dangerous thing that's being studied throughout the world. And you know, for anybody who leaves that there's a significant probability that the Wuhan virus was a leak, it becomes self evident that you don't want these things being studied broadly. Now the third thing that deep vision was going to do was to me the most objectively crazy one, which was having found these 10,000-ish viruses and established which ones were the most likely to be truly deadly, they were going to publish that list and also the genomes of these viruses to the entire world. Isn't that helpful? A world which it's important to point out, containing at the time roughly 30,000 people according to Kevin's best estimate at the time who had the tools and the know how and the wherewithal to then conjure those viruses basically make them from scratch using techniques that are called reverse genetics and sometimes it's called viral rescue. But about 30,000 people and it's what this meant is you were potentially giving the killing power of a nuclear arsenal to 30,000 completely unvedited strangers throughout the world. Some of them almost inevitably located in islands of stability like Pakistan, North Korea, Iran, etc. Yeah. Yeah. And I mean, you just look at the mental health probabilities over any population. I mean, just so if only 1% of them had brains ready to go haywire with those pills, it's an abiding problem. And that was pre-AI. We're going to talk about the contributions that AI is making to this issue. Okay. So we made a bunch of noise about deep vision. Yeah. So then what happened? What happened was the following. So you and I were hoping to influence Samantha. We didn't succeed in that. Ukraine invasion, great deal of distraction. A couple of months of crickets. And then a friend of mine reached out to me. Tristan Harris has also been a guest on your show. Along with him also, if memory serves force to give a TED talk on like 72 hours notice or something. Yeah. He's really good at that. I think he had quite a few. Yeah. No, he beat my record and he seemed so smooth and practiced. He called me along with a person named Daniel Schmockenberger. Do you know Daniel? Yeah. Yeah. Yeah. Yeah. Very, very interesting thinker thinks a lot about existential risk. And so the two of them called me and we talked, you know, is over zoom. This is still kind of mid-puck COVID about this risk. And then Daniel curated a group of, I want to say, seven or eight people, really brilliant folks. And then he and Tristan hosted it quite close to my home in Northern California. And we had what was, you know, kind of like a 12 or 13 hour brainstorm. Really electrifying conversation. People from, you know, who are experts in bio people who are experts in existential risk, our friend Livori was there, a few other people. And as a result of that, Daniel decided that he was going to really run with a ball. So he got out and he runs an organization that thinks very deeply about existential risk. He also knows far more people than I'll ever know in Washington. And so he started reaching out to folks and he soon reached an organization called Helena. I know this guy. Yeah. Brilliant, brilliant, interesting group of people. But basically a problem solving organization, it wouldn't be accurate to call them a think tank. And what they'll do is they'll, they'll identify global problems. They'll spin up groups of kind of cross-disciplinary experts to try to solve them. Sometimes they'll start, you know, a not-for-profit to tackle the problem. But they also have an investment arm that invests in world positive companies, which is my day job. So we have a lot in common. There was somebody there at Helen N. Prodig Basu, who in particular, spent a lot of time in Washington, knew a lot of folks. And so Prodig started stepping around and he very quickly found out that a couple people were already on the case, specifically Lindsey Graham and Senator James Rish of Idaho. They and their staffs had become aware of deep vision. And I think they'd sent two letters already that were mainly about other topics, but expressed concern about deep vision to USAID. So there's already this tremendous pressure coming from the Hill. And then Prodig started looking out for, you know, other people he could bring into sort of a loose alliance. He knows people in both parties, people inside the administration, outside of the administration, inside of the administration, naturally, you're going to tend to be Democrats. He reached out to people inside of USAID, people in security. One of the people that he reached out to who was very helpful was Chelsea Clinton, who was, you know, really, really helpful in reaching out to a lot of folks. She has a Masters in Public Health, a big network there. But it became a very, I'd say, extremely unpartisan group. Another Rand Paul, I think, was significantly important because he had a hearing the summer of 2022 that Kevin S. Bell testified at, talked about deep vision. And so this is a pretty, you know, unpartisan group. You look at the spectrum of folks. And what happened was just a lot of people started working very quietly, very quietly for the most part, to try to put pressure on this thing. And we learned probably a couple months after, you know, Daniel and, and Protocott heavily involved that they're had effectively, the program had effectively been defanged. That due to the pressure coming in from all these different points, there was not the, no work was going to be done. It would never be done. And the problem was more or less passed. And that was great news. And took it at face value. And then intriguingly and unexpectedly about a year later, the program was formally killed. And we didn't expect that to happen because that would be egg on various faces and so forth. But this was also a really, really positive thing because the public demise of this program, you know, sent a pretty strong signal that we don't do this sort of thing anymore, hopefully. And you know, I think, you know, the pressure continued from Capitol Hill. I know that James Rich sent a letter as late as May, very anti-division letter, probably the third to USAID. And it was September of 23 that we found that this thing was, was ultimately and completely killed. And with that, I would say an enormous source of plausible risk exited the equation. What about other countries doing that same work? What are the only ones playing this game or do other people go into bat caves and other, you know, go hunting for vectors of awfulness? Yeah. I think that the Wuhan Institute of Virology has been doing this for a very long time. So WIV, very heavily into, you know, collecting and understanding coronaviruses. Right. USAID had previously funded a program called Predict, which did this at a pretty big scale. I think they've discovered something like 1200 novel mammalian viruses. But I don't believe that there was ever a virus hunting program anywhere near the scale of deep visions. And the interesting thing when you think about the risk landscape is to contemplate how it's changed from 2021 when deep vision was authorized to today. So you go back to that period of time. And it's remarkable how few entities were in a position to have an idea, you know, frankly, this bad, right? And it's worst case. And we can talk about why and it's probably valuable to you in a moment. But it is, you know, deep vision had a clear potential to cause death at the scale of COVID, not definitely, but it certainly had that potential and possibly far far worse. Probably worse. Yeah. Probably far worse. In the scheme of things, COVID was remarkably benign as a infectious agent. Yeah. It was super infectious, but it was not super lethal. Right. Very far from super lethal. Yeah. So, I mean, I really do think of it as a dress rehearsal for something awful and we appear to have failed this dress rehearsal in a variety of ways. But we must expect to talk to you. There's no question about it. But in think about COVID, like deep vision, and we may or may not get into the numbers, but a conservative estimate is that they may easily have found, you know, six, seven, eight pandemic rate viruses. Now imagine a really malevolent actor like an Umsh and Rikiu deciding that like it is, you know, we're going to really delight the heavens if we take down civilization. COVID itself emitted from one single point and it approached our shores at a speed of four and a half miles per hour. That's the back of the envelope took two months to get here. Right. Two months to brace ourselves for that. And obviously it knocked us to our knees and the rest of the world. Imagine seven pathogens emerging all at once from 20 different airports, you know, a complete worst case scenario. I don't know how we survive that. You know, the combined fatality rate could certainly be way beyond COVID. Doctors would have no idea which of these pandemics are they're diagnosing. People could be afflicted with more than one at the same time. That's the situation where you don't worry about civilization toppling necessarily because everybody gets infected. But you do if you get to a point where no thinking frontline worker is going to go out the door and risk killing themselves and their whole family for gig worker wages. And when that happens, the supply of food, law enforcement, eventually electricity and everything else shuts down. And so that is a profoundly, profoundly, wristly scenario. So anyway, back to deep vision 2021. It's amazing how few people could have thought of an idea with this level of potential destruction. Definitely not terrorists. Osama bin Laden himself never had a wisp of that potential destruction. Not the world's worst criminal gangs or cartels, the only of conventional weapons. I mean, not even a rogue state as gigantic and chaotic as Iran could have dreamt it killing at the scale of COVID. And so you're basically left with nuclear weapons, nine people in that category, I guess, and biology. And in the world of biology, it's amazing to think of how few entities had the capability of marshalling budgets as large as deep visions, $125 million, and on top of that access to scientists, expensive labs, and to forge partnerships in a dozen developing countries in which they were going to recruit scientists to find lots of viruses and poke at them. I doubt if even ten entities in the world could have come up with an idea let alone implemented that in 2021. And the remarkable thing and the very important thing is somehow one of them did. And then think about the people who... But again, with the best of intentions. I mean, somehow they're missing the fact that this is raising risk of accidents or malicious use that's not intended by the people framing the project. It's just, again, you don't know how many other ideas are this bad and not acknowledged to be this bad. But it's quite amazing to be blind to the downside of this effort. And the best of intentions is the other side of this. Like, I have no idea who was on the USAID committee that came up with this idea, but I am quite confident it included no mass murderers, carers, or dictators. Without any questions. So somehow a very, very, very tiny population of well placed, highly placed do-goaters came up with this idea. So that is a very powerful and grounding lens through which to look at a coming era, a near-term era, in which untold thousands of people will be empowered to have ideas as bad as the vision and worse. And some of them will be terrible as well. If you'd like to continue listening to this conversation, you'll need to subscribe at samherris.org. Once you do, you'll get access to all full-length episodes of the Making Sense podcast. The Making Sense podcast is ad-free and relies entirely on listener support. And you can subscribe now at samherris.org.