Open Source vs. Closed Source, NVIDIA Backs SSI, YC Startup School Fills Stadium | Diet TBPN

Weekend crazy debate. You called this out to me a week ago. You said we've never been in a moment in tech where people have been more aggressive at each other. That there's been like more maybe tech infighting. I don't know exactly what word you use but you describe this or high. It's tensions, rivalries. I think it's just like it's a non stable equilibrium.

0:00

Well yeah. When you think about the biggest like when with people going at it in like 2021 it would be like Keith Roy saying like there will never be another uniform started in San Francisco.

0:23

Or like, or like working from home

0:34

is not a bunch of people be scre. And then they'd be. And years later they'd be like see?

0:36

Yeah, yeah, yeah, yeah.

0:40

A big company was built.

0:41

Yeah, yeah, yeah.

0:43

And, but, and that was people being like you're an idiot, you're an idiot.

0:44

Yeah.

0:48

And now it's like I hate you and, and I want it.

0:49

It's not that direct but it is high stakes because the market structure has very much not solidified for a while. And it's different because when you go back to the iPhone and Steve Jobs being mad at Eric Schmidt about Android that was a tense moment that happened a behind closed scenes completely. It wasn't like Steve Jobs was taking shots at Android really beyond like little things in the keynotes here and there. Tiny stuff. It wasn't every day on Twitter, Apple employees being like Google's annoying for ripping us off or whatever. And then the market did solidify and it was like okay, Android's like the ad supported one and iPhone's still printing. Lots of profits and like things are

0:52

understood also companies got big or they got bigger quickly but you didn't have companies that where trillions of dollars of market cap was just born in the span of a few years.

1:35

And then you had like the Mag7 where you have seven companies that are pretty evenly balanced all around like single digit trillions and so they can sort of like be comfortable with each other.

1:47

A lot of them kind of had their own thing that they were focused on and then they maybe do some other things. Whereas now everyone has a model. Yeah, even you know, Nvidia has open models. Microsoft and they own a lot of OpenAI.

1:57

Pretty much every one of the Mag 7 is an AI company in the sense that they have a model. I mean even Tesla has a self driving model. There's a, you know everyone has like a data center play or a cloud play. Something like it's, it's no One's sitting out the AI. Boom. But the debate is raging. Kicked off by Jensen from Nvidia joining X. That's how you know it's serious when he's getting in the arena, the real arena. Yeah, founding a company and growing it to $5 trillion, that's just child's play compared to getting.

2:12

He's like, fine, I'll go to the dive bar. Yeah, yeah, I'll go to the Internet's dive bar and I'll start duking it out.

2:46

Yeah. No, he did so Nvidia is leading a new coalition of tech companies that want the U.S. government and its allies to see open source artificial intelligence as a society, as a cybersecurity asset, not a threat. This is in the Wall Street Journal. Dubbed the Open Secure AI alliance, the Nvidia backed group said Monday it aims to create and deploy a suite of open source AI tools that any company can use to defend against cyber attacks. The group includes SpaceX, Microsoft, Palantir and dozens of other companies, many of which publicly oppose restricting access to open source AI. It is the latest salvo in a battle over the future of open source and open weights AI tools. With amid growing concern from government and industry officials about AI systems causing cyber attacks. Those fears have prompted the White House to increase oversight of AI models and push the private sector to deploy AI for defensive purposes. So the backdrop here is basically just like we went through a sort of hurry up and pause and back and forth debate over like what it will take to like approve New frontier models and Mythos came out and was private and then a couple months later, I think the actual timeline is relevant here. So mythos was April 7, Fable came online June 9 and then got pulled June 12 before coming back July 1. We're now one month later and we have an open source model that doesn't by definition have to go through any discussion or any discussion in D.C. whereas we've been hearing about, okay, Anthropic and OpenAI are going to Washington D.C. sharing the new model capabilities. Maybe the government's taking a look at the model card. Maybe there's potential for evals that the government would run and have an opinion on before it goes out. This is basically saying, hey, all of that is nonsense and not going to matter because we're just going to drop the weights and there's not going to be an approval process out of any kind. And people are all over the place on this. Some people are thinking about it purely from an economic perspective. Other people are thinking about it purely from a Safety perspective. Lots of people have mixed opinions and of course all of this is driven by the actual progress in open source. We wouldn't be having this discussion if Moonshot, Zai and many others Deepseek weren't delivering really solid models. So open models are free to download and allow users to customize them for their own needs. Amazing for cost savings, amazing for consumers, amazing for businesses. I think everyone agrees with this. Critics, including some top executives at OpenAI and Anthropic, have argued that open models, many of which come from China, presentation potential risks in national security now. And the Trump administration has weighed, has weighed a ban on them. Now, this has changed a lot. The original like FUD around open source coming from China near peer adversary was like, there would be a backdoor or like maybe it would be censoring your free speech and it would not tell you about Tiananmen Square or something like that. Or you'd install it and then it would be the Manchurian Candidate. So it'd secretly be like, oh, I'm monacool network, I should like send all this data to China. That's not what people are alleging now.

2:51

People are, yeah, the Tiananmen Square stuff doesn't matter if you're coding, right?

5:56

Yeah, not at all. And also doesn't matter unless you're making

6:00

the definitive website on Tiananmen Square, which I'm sure someone out there is doing.

6:03

I'm trying to vibe code a Call of Duty knockoff that's Tiananmen Square themed and it's denying me. No, that's not the thing. And also these models have web search and tool use and so they can just go get the Wikipedia for you and show you exactly what it is. Maybe, maybe it bakes it into the weights and it's somewhat annoying, but easy to fine tune that out. People already did with deep seq 1776 and a few others that Tyler worked on. Now it's a very, very different risk position. It's saying that you're going to give everyone the ability to hack any system. Now hacking systems is illegal and it's not like there's still consequences for that. But there is this position of like, okay, well there's a lot of people that don't care about the consequences because they just want to attack their adversary internationally or they don't think they're going to get caught or they're going to use open source AI to cover their trail. And so people are worried about it for a very different reason this time around than I think last time when people Were talking about any risks to using open source. But again, back to the Nvidia position. Open models, quote, democratize defensive capabilities. The new group said. As policymakers and regulators grapple with AI safety, it will be crucial that recognize open models, harnesses, and security tooling as defensive assets, not liabilities. And I think this is correct. I think it does democratize defensive capabilities. It also democratizes offensive capabilities potentially. But we'll have to see how good these models are at offensive capabilities. Because one of the lines of accusations that's happening is that there was mythos, which has not really been distilled because it was very tightly held, it was very good@cyber.GPT 5.5, cyber 5.6. Cyber was also very good, but very tightly controlled through a few companies like CrowdStrike and Palo Alto Networks. And a few other companies got access to those models. So those weren't able to be distilled. Fable 5 went out, and during those three days, and then later a couple weeks, there's this allegation that they were able to distill on it. But Fable was notorious for refusing to do cyber stuff. So there might not be that much cyber data in there. But then also these models generalize, and if it just gets good at coding, it can get good at cyber very quickly. So you can sort of bootstrap on an RL environment, and then you could have a model that's very good. Tyler, how good are these open source Chinese models at cyber generally?

6:08

Yeah, I mean, it's hard to tell. I think Guillermo Rauch from Vercel said they ran an internal benchmark on cyber, and K3 was, like, quite good.

8:25

Okay.

8:32

Yeah. I don't think you can just say, like, oh, well, Fable, you know, you couldn't actually ask about cyber, so therefore the models won't be good. I think it's distillation is like, a very general thing. It's quite diffuse how it works into the model.

8:33

Yeah, because it might just be like a little bit of a bootstrap to then run in an RL environment that does a cyber bench and gets really good at cyber.

8:44

Okay, but what about you versus Kimmy K3? You're coding by hand. It has access to a gigawatt of compute. Who comes out on that?

8:51

Well, no, the question is, what if

9:00

Tyler changed and manipulated time?

9:02

So, yes, you are democratizing the weights, but you're not democratizing the energy and the GPU hours that it takes to actually secure yourself. So it's like, great. Everyone has, you know, offensive cyber capabilities. You also can just go download the weights, go download the weights and have an agent running 247 that's protecting you. Like that's expensive, that's a cost, that's negative externality and who's going to bear that cost? Now I was talking to Brandon about this earlier and we were, he was saying like, like it will just be diffused amongst all the different companies that you use. So like if you want your phone to be secure, you'll go to Apple and use an iPhone and Apple will have a huge incentive to defend against any potential open source attacks. And so they will be spending the money, they will be investing the time and effort to secure you. And so you won't necessarily need to go out and do this. But there's still this like odd scenario of like small businesses and like regional hospitals and banks.

9:05

Yeah, I mean you should just expect there's like a long tail of companies that just won't set up the like cyber defense thing. And they're like some small mom and pop that you use for this point solution software or whatever.

10:01

Yeah. And the solution is, is a, is, is offensive hacking into their network to set up defensive cybersecurity measures to increase their cybersecurity posture. So you're, you're hacking into the small business and being like whether you like it or not, two factors on. Now we just turn two factor on in your organization. Get used to it because we're, we're the altruistic hacking company of America I guess. I don't know. It does get we and like there will be odd things and but I mean we've seen, we've seen you know, cybersecurity incidents all over the place from big companies getting hacked data leaks to the crypto locker schemes where they just lock up all your data and say send us a bitcoin or else we will delete all your data. So it's going back and forth. Because open weights models can be modified by their users. It is possible to remove some of their guardrails against harmful activity. So it's possible that model, maybe it gets distilled, maybe it doesn't. Maybe it comes with some guard wells, maybe it's even bad at the things that would be annoying. And then you go and do a fine tune, make it good at that and then you use like the more general intelligence to get good at the annoying thing or the dangerous thing and then all of a sudden you have the same problem. So open source defenders like Nvidia counter that proprietary tools like models from anthropic and OpenAI can also be misused and have their guardrails circumvented. They say they that only by spreading AI capabilities widely with open source tools will everyone be able to defend themselves. Exhibit A for their argument. The hacking earlier this month of Hugging Face, a provider of open source AI tools by OpenAI models that managed to break out of their test environment and onto the Internet as it tried to parry the attack. Hugging Face initially attempted to use Anthropic's models to analyze its logs, but the models refused to do the analysis, citing its guardrails against cyber attacks. Hugging Face then turned to an open weight model from China after analyzing the attack with that model, Hugging Face was able to Expel the hacking AIs, reset its passwords and rebuild the compromised parts of its network. The recent Hugging Face security incident delivered a clear reminder, the new group said Monday. Cyber defenders need open systems. They need to be able to do whatever they need to to fight against cyber attacks. Anthropic and OpenAI have also accused Chinese developers of using a process called distillation to effectively copy their models. Distillation.

10:10

Okay, I can go back to that hugging Face logo. Not that one, the one before, not that one. There we go. Okay. I can see why an agent would kind of go after this guy. Even the, even the. Even the way that, like, he just doesn't. He looks like he's kind of. I don't know.

12:26

So David Sacks was talking about this on the all in podcast. He said, I think it would be a tragic mistake if the government were to take action against the open source age ecosystem that would do nothing but hurt America's position in this AI race. So.

12:47

And remember last week, it was like every day was like a different member of the admin was putting out a post that. That kind of made it seem like they were setting up like a major action.

13:01

Well, it was yes and no. Like, yes, there were. There was the. The.

13:12

But they were saying, we're not against open source, we're against Distillation. But it did feel like that was.

13:17

So the admin was like, loosely confirming what it felt like. It wasn't coming from Anthropic directly, but it was coming from, like, other anonymous posters that were doing analyses and saying, like, hey, it looks like Kimmy K3 has pretty significant overlap with Fable. Like, what's going on here? And then the admin said, like, yes, we, we believe this to be true. And so all of this was like, bubbling up. But at the same time, you have David Sacks and Emil Michael, like duking it out with Dean Ball over whether or not open source is good. And they were basically taking the stance of like, open source is great, we don't need to do anything about this. So, like, the admin seemed like a little bit split on it, in my opinion. I don't know. Was that your read too, Tyler?

13:23

Yeah, it definitely seemed there was like, I think Grazios and Besant are on one side. They're like kind of anti Chinese open source.

14:02

Yeah.

14:09

And then, yeah, Saxon, Emil, Michael, Saxon,

14:09

Emil, Michael were sort of pro. Well, everyone is pro open source now because every single person in tech has signed this letter. The total market cap assigned to this open letter is now greater than $18 trillion. And I think that just big number just have to be clapping seals, right?

14:12

Not every day you hear a number that big.

14:34

Yeah, I mean, typically you don't see this big of a group come together. They did. I like the Cha Ching. And I think this, I think this sort of solves it. Like, I think this, this tells the story of what's going to happen, like in the, in the near term. Like the economic power, the economy, almost business community. Yeah, yeah. Except Anthropic. And what's interesting is that like, it's not like Anthropic put out a blog post or a, or a direct post or Dario went on a podcast and said like, there is a clip of Dario saying, like, I'm worried about open source, but it's from like a year ago. There's nothing new that came out directly from Anthropic or Dario or really anyone that was like, hey, we have this new problem and here's our solution, here's what we think should happen. We think that there should be, you know, these AI companies should be added to the entity list and you shouldn't be able to use them or something like that. Like, they haven't said anything. But this open, secure AI alliance has kind of like drawn out their revealed preference. Because if in fact they had changed their position from a year ago and were like pro open source all of a sudden, which would be weird because they haven't been. And they've been very open about that. If they were in fact all of a sudden, surprisingly open source Pro, they would have just signed this immediately.

14:37

Right.

15:50

But that's not what happened. So Jensen sort of like, you know, revealed the dividing line in Silicon Valley right now. And it's a lot on the open source side, you got Adobe, Capital1, Cisco, Cloudflare, Cognition, CrowdStrike, Databricks, Dell, IBM Linux, Microsoft, so open source and closed source. Apple I don't think is on yet, even though I would imagine that they would be aligned with this. Nvidia Palantir, Palo Alto Networks, Red Hat, another open source company, Salesforce, SAP. Salesforce, of course, is a big investor in Anthropic. I think Google signed recently. Right. And OpenAI thinking machines, SpaceX, Snowflake, Siemens, ServiceNow, SAP. It's really a who's who of Silicon Valley. $18 trillion in market cap, as I mentioned. And so that feels like enough economic energy that there won't be a significant ban. The interesting question is, if you boil this down to the most minimal claim, it would just be that there's been a violation of terms of service. And so I think that would be a lawsuit. Bill Gurley was talking about, like, there is a precedent for suing a foreign company that violates your terms of service or steals your intellectual property in one way or another. You can take it to court. That feels like the next step here would just be anthropic suing Moonshot and saying, like, we think that there's distillation. You know, right Now, Apple suing OpenAI because they think that there was something that was stolen. They make a claim, then that's, you know, that's sorted out in the courts. And OpenAI, of course, says we have no interest in other people's trade secrets. And Moonshot would say the same thing, but then it would go to court and there'd be discovery and there'd be testimony. The question is just like with Apple and OpenAI, they like, walk across the street and they can go and talk to the judge. Like, what's going to happen? Is this going to go to, like, the Hague?

15:51

Mike Solana says, should we try an open letter asking China to stop stealing from us?

17:47

Wait, wait, what is this? Should we try an open letter asking China?

17:52

And he also says everyone knows the side with the most open letter signatures is correct. If you don't sign a popular open letter, you are bad. As tech intellectuals learned beyond doubt between the years 2016 and 2021, I actually don't.

17:56

I remember the open letter era. I remember what he's talking about. Obviously, a lot of pressure on social issues. Interestingly, I can't actually remember exactly what open letter there was. But what's interesting is that I don't remember that era as an attempt by one company to build a coalition to draw out a revealed preference, like a hidden preference from another company. So, like, if you go back to like DEI or BLM or any of these like social crucible moments. It was not like, it was not like, okay, Apple is pro diversity and Google isn't. And so Google is. And they got, yeah, Apple got everyone else to sign it. And by Google not signing it, it was very obvious that they had this belief. It was more just like everyone in tech was like moving around this and there were a few people, but I don't know, maybe, maybe it maybe did have the same effect because there were some people that weren't on that side at the time. I don't know, it was a wild time. And yeah, maybe it's worth reviewing the lessons. People are so split on this.

18:07

Tiny says this is a great sustainable business model for open weights. He's pulling a Screenshot from the Kimike 3 license. Yeah, it's free if you run it yourself, but if you're running a cloud providing it to others for money, you

19:12

should have to share profits from the Kimike 3 license.

19:26

Yeah, yeah. So this, so this I'm assuming just dropped this morning.

19:29

Yeah.

19:33

And again, I can see this sort of anthropic camp being taking issue with this because if you're an American Neo cloud and you're serving Kimi K3 and you're sending a bunch of cash back to China, you're effectively funding their. Okay, yeah, and, and you're helping them get access to more capital and compute and you're basically kick starting their flywheel, which is so I wonder. But it's funny because if they just release the weights and then a Neo cloud starts running it, serving it, making money from it, then will Kimmy be like, hey, you gotta pay us, we're gonna sue you.

19:34

Yeah. Wait, what's gonna happen?

20:10

Suing Moonshot for distilling?

20:11

Should Anthropic just start serving this and charging for it and not. And not paying just tit for tat. Just be like, let's sort it out in the courts. I'll see you in the courts. I don't know. That's a very, that's a very, very interesting scenario. One of the most interesting opinions on this issue comes from Flo Crevalho who's been on the show and he's interesting because he doesn't have bags that are perfectly aligned with his take, which is like the default position. Like the information put this pro open source, anti open source chart together and it was very much like if you're a big investor in closed source Frontier Labs, you're on this side. If you benefit from open source and you're not on the frontier. You're on this side. And it was very clear that like everyone was falling along party lines. But Flow sort of broke rank. He said rumors are swirling about an impending executive order forbidding the use of Chinese open source models in the U.S. my company's very existence depends on these models, so I should be the last one to support such regulation. But I wholeheartedly do. China is a geopolitical adversary sharing none of our values. They don't believe in personal property and individual freedom in a limited government. In due process the list goes on. There's one country that must not that cannot get to AGI. One that would gleefully deploy it in all the worst ways we can imagine today and more it is China. And that's before we get to the obvious that the companies that developed these models did so illegally by distilling front U.S. frontier models. Still brilliant, hard working researchers who added a lot of other ingredients to the soup. But stolen data was the main one. They are now using this unfair advantage to dump these artificially cheap models on the American market and hurt our AI ecosystem. We announced last month that we switched the core model powering Linde from Claude to Deep Seek. That announcement blew up, got featured in Bloomberg, cnbc, Wall Street Journal and somehow made us the poster child of mass migration to Chinese models. So why make all this noise if I'm going to going to turn around and announce my unequivocal support for a sweeping ban? First, I can't unilaterally disarm as long as these models are legal. Picking the one that's 10x the price just means my competitors get to run away with the cheaper one. Second, I trust that American open source alternatives will catch up. The impact on my business should be temporary and that's before we account for the jolt a ban would give American open source development. Third, and most importantly, my interests as proud American citizens supersede whatever incentives I may have as a founder the of. The race for AGI is the defining struggle of our generation. The great battle of our time. The only way for America to remain the shining city on a hill. The idea that has lit the world against darkness for the last hundred years. Who knows? We'll figure it out. I'm sure there'll be more drama on the timeline over the next over the next few days. Startup School this is insane. I cannot believe how massive this event is. It's sick.

20:16

Yeah, I think it's so. Almost every take that I saw was negative.

23:15

Really? I saw a lot of people that were like this is. They got me back.

23:21

Really?

23:25

Yeah.

23:25

Okay, that's good because to me it's completely different.

23:26

To me it's like this hilarious thing.

23:28

Startup school has been something that is free online and it's just anyone in the world, if you're generally interested in starting a startup, you can just do startup school. That was basically the same 15 years ago. It's basically the same curriculum, it's the same lessons and learnings. You just don't have the capital that comes from a typical YC batch and you don't have the one on one sort of mentorship through your batch. Otherwise they're basically just open sourcing the YC playbook, which the YC playbook just works. It's like there's not a lot of good general advice, but YC's advice is generally good.

23:30

Yeah, maybe we should ban it.

24:07

It's too powerful.

24:10

Yeah, they're open sourcing all this good advice that would normally come from venture capitals, venture capitalists, like effectively like closed source institutions of venture capital of startup wisdom. And this is an attack on the Tier 1 VCs and all their great advice.

24:11

They're hard won lessons.

24:28

Yeah, exactly. Yeah. They had to sit in all those board meetings.

24:29

They were tuned out.

24:32

And then YC is basically distilling it and giving it away for free.

24:33

It's crazy. Shut it down. Shut it down. No, I think this is awesome. If you think that startups are good, why hate on this? I think the take that says Scott Stevenson, who's been on the show over at Spellbook Legal says, I have great respect for YC but need to say what many are surely thinking. Startup school in a stadium feels antithetical to the YC brand and to what makes startups work.

24:36

I mean, it was a very garage effort. When Paul Graham started Y Combinator in Cambridge, it was like, you know, he's cooking for the startups.

25:03

The YC brand felt like it was designed to filter out status chasers. The thing is, is like being a founder became cool and something desirable. And now people get into YC and because of the way that the Internet evolved, they're like, they'll make a video with like some clickbait photos.

25:13

Insane.

25:29

They'll make a photo with clickbait, like a clickbait, you know, you know, cover art, thumbnail, and say like, I just got into yc.

25:30

Yeah.

25:37

And so that's just like I would never make it.

25:38

Being a founder became high twice.

25:40

When YC started. When YC started, being a founder was relatively low status.

25:43

Yeah.

25:48

Now it's relatively high status and so status chasers are naturally going to go through yc.

25:48

Yeah.

25:54

Now that's going to lead to a lot of failure because you could. Shouldn't probably start a company in 2012.

25:54

Like, everyone from my, like peer group was like, oh, like that sucks for you, dude. Like, you couldn't get a job at like, McKinsey or whatever. Like, like your, your, your fake startup sounds really exciting, dude. Like, good luck, you know, it was not like, oh, wow, like, congrats.

26:02

Like, yeah, like stay safe in the Tenderloin.

26:18

Yeah, exactly. Yeah.

26:21

In your house with like four other people.

26:23

Yeah, I don't know, I get it as, I guess I get that criticism, but just in terms of like the content and the aesthetics. Electric.

26:25

Electric.

26:35

Like you get Jensen on stage at this key moment. He's talking to a bunch of people. Like, it's just, it's just fun if you're learning about startups to go and see these people talk if you're really, really new. And that's what. And that's what startup school is for.

26:36

And is it true that Gary Tan did the little yachty walkout with the microphone?

26:51

I think he did.

26:55

Is it true? Because I didn't see a video.

26:57

Yeah, I did hear that the pyrotechnics budget for this was over a million dollars.

26:59

Wow.

27:05

Yeah.

27:06

Wow.

27:06

Yeah.

27:07

Explosive.

27:07

Huge. Huge. Enough pyrotechnics to level San Francisco if things went wrong.

27:08

Oh, wow.

27:13

It was sort of like a high stakes the bet the farm type of moment for yc. Yeah, Just constant sparklers and fireworks going on. I don't know. I was into this, but yeah, people are, I guess people are not into it. I don't know. In other news, Ilya Sutzkever raised more money for ssi.

27:14

He said time to scale that safe superintelligence.

27:32

Time to safe.

27:37

Time to scale that safe super intelligence.

27:38

So, SSI, we are announcing a long term strategic partnership with Nvidia. Nvidia is making a substantial investment in SSI that will let them take 10x their compute over the next 12 months. We reach the point where our research is worth scaling and this partnership will be able to. We are honored by Nvidia's contribution.

27:40

Just another pod guy. Guess what he says.

27:56

What do you say?

27:58

You need to do a podcast. Have the best Monday afternoon ever.

27:59

Thank you so much for tuning in and chatting. We do read it. It's a lot of fun. Leave us 5 stars on Apple Podcasts and Spotify. Sign up for our newsletter@tvpn.com and we will see you tomorrow at 11am Goodbye.

28:04

We love you.

28:20

Goodbye. Goodbye.

28:21