Economist Podcasts

White hat, black box: AI’s next chapter

23 min
Apr 22, 20266 days ago
Listen to Episode
Summary

This episode explores Anthropic's new Mythos AI system, a powerful hacking tool deemed too dangerous for public release. It also examines how women voters are reshaping Indian elections through targeted cash transfer programs, and profiles Senegal's national football team ahead of the World Cup.

Insights
  • AI companies may need to adopt restricted release models for powerful systems that pose security risks, fundamentally changing the industry's open access approach
  • The shift toward safety-first AI releases could create new power dynamics favoring established companies over startups who lack credentials for early access
  • Women's voting patterns in India are driving more pragmatic, welfare-focused political campaigns as female turnout now exceeds male participation
  • Direct cash transfer programs to women voters may improve individual financial independence but risk crowding out structural investments in education and healthcare
  • The dual-use nature of advanced AI systems is forcing governments to consider new regulatory frameworks that balance innovation with national security
Trends
Restricted AI model releases becoming industry standard for powerful systemsGovernment regulation of AI following voluntary industry safety measuresWomen voters driving pragmatic welfare-focused political campaigns globallyDirect cash transfers replacing traditional social programs in developing democraciesAI cybersecurity capabilities outpacing defensive measuresChinese AI labs potentially following Western safety protocolsCompute resource constraints forcing strategic AI deployment decisionsNational security considerations shaping AI access policiesFemale political participation surpassing male engagement in emerging democraciesPolitical parties competing through welfare spending rather than ideological appeals
Companies
Anthropic
Developed Mythos AI system deemed too dangerous for public release due to superhuman hacking capabilities
Apple
One of 11 select companies given early access to Anthropic's restricted Mythos AI system
Microsoft
Selected as systemically important company for early Mythos AI access to test cybersecurity defenses
Nvidia
Chosen for early Mythos access due to its systemic importance in AI infrastructure
JP Morgan
Only financial services provider selected for early access to Anthropic's Mythos AI system
Palo Alto Networks
Cybersecurity company given early access to Mythos AI for defensive testing purposes
Broadcom
Technology company selected for early Mythos AI access due to systemic importance
OpenAI
Mentioned as competitor advocating for more democratic AI release schedules with identity verification
People
Alex Hearn
Expert guest discussing Anthropic's Mythos AI system and its implications for the industry
Dario Amodei
Referenced as head of Anthropic making decisions about AI model safety and release
Kira Huyu
Reporter covering Indian elections and women's political participation trends
Jason Palmer
Host of The Intelligence podcast conducting interviews on AI and Indian politics
Jon Fasman
Profiling World Cup teams including Senegal's national football squad
Quotes
"It's a superhuman hacker that's so dangerous they can't release it. It's forcing skeptics to accept that some of the dangers of AI may come sooner than they expected."
Alex Hearn
"We've known this is coming. AI systems have been getting better and better at software engineering for the last three years."
Alex Hearn
"Women are much more driven by really concrete, tangible welfare policies. Less than 10% are interested in voting based on ideology or culture war issues."
Kira Huyu
"If you need to prove your credentials to access a system that is required to secure your own networks, then that's inherently an advantage to those who can provide their credentials."
Alex Hearn
"In India's first general election, 3 million Indian women were struck off the voter list because it had not occurred to them to register with their own names."
Kira Huyu
Full Transcript
5 Speakers
Speaker A

With no fees or minimums on checking accounts, it's no wonder the Capital One bank guy is so passionate about banking with Capital One. If he were here, he wouldn't just tell you about no fees or minimums. He'd also talk about how most Capital One cafes are open seven days a week to assist with your banking needs. Yep, even on weekends it's pretty much all he talks about in a good way. What's in your wallet? Terms apply. See capitalone.com Bank Capital One NA Member FDIC this episode is brought to you by Progressive Insurance. Do you ever think about switching insurance companies to see if you could save some cash? Progressive makes it easy to see if you could save when you bundle your home and auto policies. Try it@progressive.com Progressive Casualty Insurance Company and affiliates. Potential savings will vary. Not available in all states.

0:00

Speaker B

The economist. Hello and welcome to the Intelligence from the Economist. I'm your host Jason Palmer. Every weekday we provide a fresh perspective on the events shaping your world. In India, there's a big political shift underway. The country's women are becoming an ever more potent force in the electorate. Whether what politicians are doing to win them over is vote buying or genuinely empowering is not entirely clear. And my former co host and a sports nut, Jon Fasman, is leading us up to the World cup by profiling the countries of 10 teams that are in contention. This week, it's Senegal. First up though.

0:55

Speaker C

Normally when someone tells me they've got a new superhuman AI but I'm not allowed to see it, they're telling tall tales. But with Anthropic's new Mythos AI system, there's a chance they're telling the truth.

2:03

Speaker B

Alex Hearn is the Economist's AI writer.

2:17

Speaker C

It's a superhuman hacker that's so dangerous they can't release it. It's forcing skeptics to accept that some of the dangers of AI may come sooner than they expected. And it's also making the AI industry reassess its own business model.

2:20

Speaker B

So let's start with this new piece of mind bending tech. What is Mythos?

2:37

Speaker C

Claude Mythos is the latest AI system from Anthropic, the makers of Claude. It's, as the name Perh suggests, bigger and badder than its previous models, Haiku, Sonnet and Opus. Those are getting larger each time, and Mythos is the biggest yet, but unlike those previous models, it's not been released. Anthropic went to all the effort of training it and then as a preview version only gave it to a select group of partners 11 named groups and 40 smaller organizations. And that's because it is, Anthropic, says a tremendously good hacker. You pour money in one end, you get some software vulnerabilities out the other. And that means Anthropic thinks it's too dangerous to make available for general release.

2:42

Speaker B

So are you one of the mysterious 40 odd entities who has received the model? Have you had a play?

3:24

Speaker C

I am not. I have previously been given access to models that Dario Madei, now the head of Anthropic, says are too dangerous for public release. But this time, no, it really is kept very much behind closed doors. But we have seen evidence of the claims that Anthropic are making. They have been putting it to work, finding software vulnerabilities in open sour code, things like operating systems and media encoders. And they've published a couple of the ones. They found already a complex bug in the operating system, OpenBSD, that had hidden unchanged for 27 years until mythos discovered it.

3:29

Speaker B

And so essentially the rest of those companies are being given access so they can find the holes in their own stuff and patch them before a general release. Is that the idea?

4:04

Speaker C

Yeah, exactly. So Anthropic picked 11 companies, including Apple, Microsoft, Nvidia, JP Morgan, the only financial services provider, Palo Alto Networks, Broadcom, there's 11 of them. And it tried to select companies with systemic importance. Operating system manufacturers, browser manufacturers, big financial institutions. And the idea is partially to check that Mythos can do what it can do, and also just to give these huge systemic institutions time to build their defenses up before Mythos or something of equivalent quality is made available to people who might use it as an attacker.

4:13

Speaker B

And you're putting aside your skepticism for the moment. I mean, it has to be said that saying it's this badass suggests that we have the best thing in the world and you should pay for it.

4:49

Speaker C

Absolutely. And there are a lot of reasons to be sceptical. This plays into Anthropic's entire bit very well. They are not only keen to present themselves as the makers of the best coding software in the world. And that's all hacking really is, right? A specialised form of coding. They also like presenting themselves as the most safety oriented lab, and this is the most safety oriented move you can do. There's also lesser advantages. It lets them handle a compute crunch that they're going through with elegance and grace. This is a big, expensive to run model. It seems likely that were Anthropic to make it available for general release, they don't have the GPUs to run it at the level that their customers would want. They would be forced to put prices up in a very obvious rationing move, or just ration it directly with usage limits. So this sort of staged release lets them show off that they've got all of this power without admitting that they don't have the power to run it. And then also it prevents the photocopiers from being started up if you make it available to a select group of partners. Those partners are trustworthy organisations who aren't going to take your intellectual property, feed it in as training data to their own models and produce a fast follow in three to six months. Which is exactly what Anthropic has already accused some of the largest Chinese labs of doing with its previous Opus models.

4:58

Speaker B

I suppose, though, this brings us into an era that lots of people had said was coming. The idea of the dual use nature of AI coming to bite us at some point when it got good enough.

6:16

Speaker C

Exactly. And this is one of the reasons why I'm less sceptical than that long list of reasons why this is the sort of thing Anthropic would love to do. Might suggest. We've known this is coming. AI systems have been getting better and better at software engineering for the last three years. They've passed a load of qualitative thresholds already, and it was a matter of time until a system was created that was a very capable hacker, because that's what happens when you get better and better at software engineering. There were only really a few open questions. One was whether or not you could make a system that was a good hacker and teach it the ethics required to not be a malicious hacker. And the other was if someone made a system that was a good hacker and couldn't teach it those ethics, whether they would release it anyway. Anthropic shows that one possible answer here is they cannot yet teach Mythos to be safe, but they can keep it behind closed doors. So the next big question is whether, you know, we get these fast followers eventually catching up and if anyone cracks the how to make this a safe thing to release before someone gives in and just releases the unsafe version to the public at large.

6:26

Speaker B

But in a number of ways, this doesn't seem very sustainable or very equitable. I suppose the companies that are inside the tent must be very pleased to get this early access. But it can't stay that way forever, right?

7:35

Speaker C

I mean, whether or not it can stay that way forever is, I think, still an open question. It's not clear right now how quickly other people will catch up to Anthropic. And at least in the US there seems to be broad agreement that general release for a model of this class isn't a smart thing to do. OpenAI is making hay about the fact that it wants a more democratic release schedule, but even that democratic release schedule still involves verifying people's real identities and checking they work in cybersecurity and so on. The question hovering over everyone's head is whether or not the Chinese labs will follow. They tend to have had a more laissez faire approach to safety, but at the same time, the Chinese government is making noises of concern. Everyone wants this sort of power, but I don't think anyone wants to be responsible for unleashing an era of all systems being hackable by all people. So there's a chance that some form of cautious release will become the norm in this space. But then, yes, the power dynamic that creates ought to, I think, concern a lot of us. If you need to prove your credentials to access a system that is required to secure your own networks, then that's inherently an advantage, a boost to those who can provide their credentials. It harms startups, it harms people getting their leg up in the industry, and it helps people who are already on top.

7:46

Speaker B

Dare I to ask how regulation might come into this to even the score, to keep everybody honest?

9:06

Speaker C

Well, I mean, the good news is this has provided a pretty obvious model for any government body to copy. Until Anthropic voluntarily did this, behind closed doors access, it would have been a big thing for a government agency to enforce. Now that they've done it, it's somewhat easier for a regulator to look at the other labs and go, follow their lead or we'll come down on you. A lot of government regulation begins as voluntary action from a sector and then gets reified over time. And I think this will be no different. The question, yes, is whether or not the government feels like it has the responsibility or authority to verify who those insiders are. It adds democratic legitimacy if it does, but also has the uncomfortable overtones of a government picking winners, choosing insiders, and banishing outsiders. One reason why they may well want to do that, though, is the whole thing has national security implications. You obviously want your software and that of your allies to be better protected than those of the people you are trying to hack. At the same time, the American intelligence community has always struggled, struggled with this dual mandate that it protects American cybersecurity, while also hoarding the ability to use American technology to hack its foes, and I think this is no different.

9:12

Speaker B

Alex, thanks very much for your time.

10:23

Speaker C

Thank you for having me.

10:25

Speaker B

You can hear lots more from Alex on our snazzy subscriber only video shows the Economist Insider and Inside Tech. He and our senior editors ask how powerful the five bosses of the big AI firms could become and whether they should have that much sway. Subscribers can find the Economist Insider on our app and homepage.

10:29

Speaker A

This Economist podcast is sponsored by Bill, the intelligent finance platform that helps businesses and accounting firms scale with proven results with AI powered automation. Bill isn't just moving money, they're simplifying financial operations. For nearly half a million customers, Bill has securely processed over a trillion dollars in transactions. That's proven infrastructure. Ready to talk with an expert? Visit bill.comproven and get a $250 gift card as a thank you. That's bill.comproven terms and conditions apply. See Offer page for details. With no fees or minimums on checking accounts, it's no wonder the Capital One bank guy is so passionate about banking with if he were here, he wouldn't just tell you about no fees or minimums. He'd also talk about how most Capital One cafes are open seven days a week to assist with your banking needs. Yep, even on weekends it's pretty much all he talks about in a good way. What's in your wallet? Terms apply. See capitalone.com bank capital1NA member FDIC.

10:59

Speaker D

A couple of weeks ago, I attended an election rally on the outskirts of Kolkata in the state of West Bengal.

12:13

Speaker B

Kira Huyu is an Asia correspondent for the Economist.

12:22

Speaker D

And as the rally goers for the ruling Trinamul Congress assembled on this narrow dirt road, it occurred to me that what I was looking at was a perfect visualization of the trend that I'd come here to witness, which was that, like in Indian elections, women had moved center stage at the front. You had an all female marching block and they were dressed in bold prints. They were loudly chanting their way through the town. And then the men had gathered at the back, almost like the women's shadow. Now, this has been a busy month for state elections in India. We have four states and one Union territory voting across the country. And in West Bengal, the election is taking place in two stages, the first one happening tomorrow and then the Second one on April 29th. And what all of these elections turn out to have in common is a striking demographic shift. Women are determining and changing how Indian elections are fought.

12:26

Speaker B

So that prominence of women in the electoral sphere is a new thing for India.

13:38

Speaker D

It's most definitely a new thing. In India's first general election, in the early 50s, you actually had a situation where 3 million Indian women were struck off the voter list because it had not occurred to them to register themselves with their own names registered as wives or daughters of male family members. And now you have a situation where, for the first time in 2019, female turnout actually surpassed male turnout. And that's something that we saw again in the 2024 national election. And so Indian women have gone from being a minor figure to being entirely central to who wins elections.

13:42

Speaker B

And so this is just a straightforward story of modern women's empowerment in India.

14:18

Speaker D

It is definitely the case that Indian women tend to vote more when they have a job, when they get a better education, when they're more politically exposed. And so, in many ways, yes, voting reflects women's improved place in society. But I can say, having gone through the sweated procession in West Bengal, that it was not, in fact, full of feminist postgrads. I spoke to a marcher who was a jobless widow with a disabled daughter. I spoke to a Dalit woman formerly known as an outcast, who was struggling to even produce the right paperwork to vote in the upcoming election. And so what's happening in these kinds of spaces also suggests to you that there is a way in which Indian politicians have figured out how to speak to marginalized women as well.

14:23

Speaker B

What do you mean that politicians have learned how to do that? What are they doing?

15:09

Speaker D

We have some really great research by Sanjay Kumar and colleagues at the center for the Study of Developing Societies, which is India's premier social science institute. And that research has suggested that women are making Indian elections more pragmatic. Women are much more driven by really concrete, tangible welfare policies. Less than 10% are interested in voting based on ideology or culture war issues. And that's quite distinct from the way that Indian men often vote. And so election strategists sat down and said, all right, what is the most tangible thing that you can possibly do in terms of welfare for women? And where we seem to have ended up is cash sending women monthly cash transfers.

15:12

Speaker B

But what do those programs look like in practice on the ground?

15:56

Speaker D

So the sums that are supplied range from about 800 to 2,500 rupees per month. That's about 9 to $27, which may not sound like a lot, but in India is quite significant, given that Indian women are half as likely to hold a job as men. And so these kinds of sums are, in fact, quite life changing. And so what you have is now at least 16 out of India's 28 states have female only direct cash transfer schemes. And that's up from just a handful in 2022. And suspiciously many of these were introduced just before election day.

16:00

Speaker B

Are they means tested?

16:40

Speaker D

So they are never means tested. There are varying criteria depending on the scheme. Age, income, marital status. But once you've cleared those, there is nothing you have to do, nothing you have to prove that you're doing and that money just gets sent to you.

16:42

Speaker B

But what about the notion that it is, or at least looks like vote buying?

16:57

Speaker D

There is a lot of interesting social scientific research that suggests that some of these schemes can be very beneficial. If you look at what's going on even just in these state elections though, a lot of it does look very haphazard. So move away from West Bengal to the state of Tamil Nadu, which is the other place where we have voting on the same day. It's now in West Bengal. And here Chief Minister mk, stalling in anticipation of the elections, has dispatched what he calls a summer special package worth about $50 to more than 13 million women in Tamil Nadu. He's promised also to double the state's all female cash grant if re elected. This is a pledge that was quickly matched or outbid by all the opposition parties.

17:01

Speaker B

Successful? It might be. It does sound expensive though.

17:45

Speaker D

Yeah, the cash frenzy is getting a little out of hand. In the last financial year, the states that had these schemes spent more than $18 billion worth on unconditional cash transfer programs, mostly for women. If you look at profligate West Bengal in particular, where state government debt is 38% of the state's GDP, which is approaching record levels. Lakshmi Bandar alone, which is the flagship cash transfer scheme, consumes 10% of the state's revenue receipts. And that's just one of West Bengal's many, many such programs.

17:48

Speaker B

I guess the question, putting the politics aside, is whether this does really improve Indian women's lot.

18:23

Speaker D

There is some evidence suggesting that it improves financial independence, it allows women to invest in dreams beyond their survival, think about setting up businesses and so on and so forth. So at an individual level there are certainly success stories. I think the big concern though is that what seems to be happening, and this is something that India's financ Defence Ministry warned us of a couple of months ago, is that the emphasis on cash transfer schemes is starting to distract from policies that might, more durably, on some structural level, improve women's lives. So we're starting to really see a crowding out of investment in the delivery of education and healthcare. It is about time that India's political class takes seriously the other half of the world's largest democracy. But it would also be high time that these women were offered some more truly transformative policies.

18:30

Speaker B

Kira, thanks very much for your time.

19:25

Speaker D

Thank you for having me. Jason,

19:27

Speaker B

A quick word about something exciting from our sister division, Economist Education. They've got a new course developed by the kinds of senior editors and journalists that you hear on this show and it's all about geopolitics. They're joined by guests from academia, business and government to provide a nuanced view on how to think about and deal with international relations. The course is designed to give you insights you need to figure out how geopolitics affects you and your organization, navigate all the uncertainty and act decisively. Sign up by May 6th and tell them we sent you. You can save 15% with the now familiar all caps code intelligence. Just go to education.exterator.com intelligence.

19:42

Speaker C

Rigor Song for the nations cup and

20:28

Speaker E

he's won it for Cameroon.

20:32

Speaker C

Up he steps and scores, which gives Zambia's Cipollo Polo their final first ever nations cup title. So under these lights, history sharpens its pen. Senegal against Morocco, the two highest ranked teams on the continent summoned here for the first ever meeting.

20:34

Speaker E

African football has promised so much for so long. One of football's greats, Pele, once predicted an African team would win the World cup by the year 2000, but it has so far failed to make a truly great impact on the world's biggest stage.

20:55

Speaker B

John Fasman is our senior culture correspondent and is counting down to this summer's FIFA World cup by introducing us to 10 of the teams taking part.

21:11

Speaker E

Among the continent's record 10 teams in this year's tournament is Senegal, making its third consecutive World cup appearance and fourth overall. It is one of just four African countries to have reached the quarter finals, which it did in 2002 after defeating France, the defending champion. They lost to Turkey on a golden goal. The Lions of Tauranga, as the team is known, have also won the Africa cup of nations, otherwise known as afcon, twice. Sort of. Hopes are high this year. Koulibaly captains the team. He's played professionally across Europe and now Saudi Arabia. His vice captain is Idrisa Gai. Together the two have played in more than 230 international matches. Last June, Senegal became the first African team to beat England in 22 attempts, and in January they defeated Morocco 1 nothing to win that second AFCON title. But that quickly turned into a farce.

21:20

Speaker C

Paptiao is taking his players off the pitch.

22:26

Speaker E

No, you can't do that. You cannot do that.

22:30

Speaker C

Well, this is extraordinary. I've never seen anything quite like this.

22:33

Speaker E

Senegalese players left the pitch in protest after a stoppage time penalty was awarded to Morocco in the final, though the players did return to the field 17 minutes later. The Confederation of African Football ruled last month that by leaving even briefly, Senegal had forfeited the match and gave Morocco a win. Though Senegal has appealed off the pitch too, Senegal has gone through a lot. In 2024, Basiru Jumaye Faye won the presidency in a landslide just two weeks after he was released from prison. Jumaye, as he's known, promised to root out corruption, create jobs for young Senegalese and loosen ties with France, Senegal's former colonizer. But the country's public finances remain woeful, with public debt around 130% of GDP. That has forced Jermayeh to govern more conventionally. He has raised taxes, canceled some government contracts, cut 19 government agencies, and paused some infrastructure projects. The country has still just narrowly avoided default and its bonds are junk status. Nearly 4% of Senegalese live outside of Senegal, and remittances account for 10% of the country's GDP. Expect loud cheering this year for the Lions of Tauranga, not just in Dakar, but across Europe and America as well.

22:37

Speaker B

That's all for this episode of the Intelligence. We'll see you back here tomorrow.

24:28

Speaker A

With no fees or minimums on checking accounts, it's no wonder the Capital One bank guy is so passionate about banking with Capital One. If he were here, he wouldn't just tell you about no fees or minimums. He'd also talk about how most Capital One cafes are open seven days a week to assist with your banking needs. Yep, even on weekends, it's pretty much all he talks about in a good way. What's in your wallet? Terms apply. See capitalone.com Bank Capital One NA Member FDIC this episode is brought to you by Progressive Insurance. Do you ever think about switching insurance companies to see if you could save some cash? Progressive makes it easy to see if you could save when you bundle your home and auto policies. Try it at progressive. Com, Progressive Casualty Insurance Company and Affiliates. Potential savings will vary. Not available in all states.

24:51