The AI Podcast

NVIDIA's New Alliance with Super Safe Intelligence

12 min
Jul 28, 202626 days ago
Listen to Episode
Summary

The episode covers major AI industry developments including Super Safe Intelligence's multi-billion dollar NVIDIA partnership, Claude Opus 4.7's impressive coding benchmarks, Google's expanding AI Overviews reach, and the launch of an Open Secure AI Alliance by NVIDIA, Microsoft, and IBM to defend against AI agent threats.

Insights
  • SSI has raised $7 billion with zero products shipped, signaling investor confidence in foundational AI safety research over near-term commercialization
  • AI models can now recreate complex production software (61,000+ lines) in hours for under $250, fundamentally changing software development benchmarks
  • Google AI Overviews appearing in 43% of searches is redirecting publisher traffic away from external websites, threatening traditional content monetization
  • Open-source AI models proved critical when closed systems failed during security breaches, demonstrating real-world value of open-weight alternatives
  • Robotics companies are using crowdsourced remote control to generate training data, shifting from model-centric to human-control-centric AI development
Trends
Massive capital concentration in AI safety/reasoning research with multi-year timelines before product launchAI-generated code quality reaching production-level complexity, accelerating software development cyclesSearch engine AI integration reducing click-through traffic to external websites and disrupting publisher economicsOpen-source vs. closed-source AI becoming a geopolitical and security issue with regulatory implicationsHuman-in-the-loop data collection for robotics shifting from synthetic to real-world crowdsourced control patternsAI agent security becoming critical infrastructure concern requiring collaborative industry defense frameworksBenchmark evolution from model performance to real-world software recreation and practical task executionCompute platform partnerships becoming strategic moats for AI research labs and hardware manufacturers
Companies
Super Safe Intelligence
Secured multi-billion dollar investment from NVIDIA and 10x compute increase; founded by Ilya Suszkever after leaving...
NVIDIA
Partnering with SSI, launching Open Secure AI Alliance, open-sourcing NOOA framework for AI agent testing and auditing
OpenAI
Competing with Anthropic on AI model leadership; advocating for restrictions on open-weight AI models
Anthropic
Claude Opus 4.7 achieved 61,000-line software recreation in 14 hours; competing with OpenAI on model capabilities
Google
AI Overviews now appear in 43% of searches, up from 28% year-over-year; partnering with SSI on compute infrastructure
Microsoft
Co-launched Open Secure AI Alliance with NVIDIA and IBM to defend against AI agent threats
IBM
Co-launched Open Secure AI Alliance with NVIDIA and Microsoft for open-source AI security tools
Hugging Face
Used open-weight GLM 5.2 model to defend against security breach when closed AI systems refused forensic analysis
Enigma
Raised $70 million to develop robotics with crowdsourced remote control data collection; operates robots in Israel an...
Cohere
CEO interviewed on host's AI Chat podcast; raised over $1 billion for AI model development
Alphabet
Investor in Super Safe Intelligence; backing foundational AI safety research
Sequoia Capital
Investor in Super Safe Intelligence's $7 billion funding round
Andreessen Horowitz
Investor in Super Safe Intelligence's $7 billion funding round
Lightspeed Venture Partners
Investor in Super Safe Intelligence's $7 billion funding round
Shopify
Mentioned in episode introduction as e-commerce platform enabling business operations
People
Ilya Suszkever
Founded SSI after leaving OpenAI; leading AI safety and reasoning research with $7 billion in funding
Quotes
"They literally have not even shipped a product yet, they don't have any revenue, and they've just gotten this multi-billion dollar investment from NVIDIA"
HostEarly segment on SSI
"The benchmark is how quickly can you recreate an entire piece of software"
HostClaude Opus 4.7 discussion
"Google is becoming basically a destination where you get your answers answered directly just like ChatGPT instead of pointing you to other websites"
HostGoogle AI Overviews segment
"Closed AI systems block defenders from investigating breaches"
Host (paraphrasing Open Secure AI Alliance argument)Alliance discussion
"Robots fail, not because AI models are weak, but because the way humans control them is really clunky"
Host (describing Enigma's thesis)Enigma segment
Full Transcript
. I have Ornod in 2013 built. We make a bike. Thanks to Shopify, we can run the company without having a lot of technical knowledge. We can buy everything from the back-end to the front-end and sell products hard to online. If Shopify would be a bike-accessoire, it would be the bike itself. It is the thing that you do. Run the company on Shopify. Start your free period on Shopify. If you want to get access to this episode and my next 30 episodes all ad free, so there'll be no ads on them, go check out my podcast AI chat. You can go search for that on Spotify or Apple. It's AI chat. I'm going to post all of these news episodes and I'm also posting interviews. Like I just interviewed the CEO of cohere. They've raised over a billion dollars for their AI model talking about what they're going to be spending the money on and the direction of the AI industry, along with all of this new stuff. So if you want to go check it out with no ads for free, It is AI chat. Welcome to the podcast. Super safe intelligence has landed a massive new deal with NVIDIA for a huge boost in computing. Claude Opus 4.7 has just finished a two week coding job. There's this basically new benchmark that has come out that is really exciting to me and I'll tell you why. Google AI overviews now appear in 43% of searches. This is up 15% from a year ago. let's talk about how the landscape is shifting specifically in SEO. NVIDIA, Microsoft, and IBM have all launched Open Secure AI Alliance to defend agents. We're going to talk about why there's so much drama in that. Enigma has exited stealth and they've just gotten $70 million to rethink how humans are talking to robots. Safe Super Intelligence is only two years old. It's the research lab that was founded by Ilya Suskova after he left OpenAI, and they have secured a multi-billion dollar investment from NVIDIA and also access to their next generation Veriruban GPU platform. This deal in particular is basically going to increase their compute power by about 10x, which is a massive jump, and it's going to let them scale their research into AI safety and reasoning. And you know what's crazy about this company, if you've been following along, they literally have not even shipped a product yet, they don't have any revenue, and they've just gotten this multi-billion dollar investment from NVIDIA, really just riding off the fact that Ilya Susquevar is, you know, famous, was one of the OGs at OpenAI. And of course, he's, when I say famous, it's famous because he's a very incredible AI researcher. But still, it's, I mean, just really running off of the name, which is amazing. SSI has now raised $7 billion total. They have $32 billion for evaluation. And their backers are NVIDIA, Andresen Horowitz, Alphabet, Sequoia, Lightspeed something that he really have all the biggest tech players. They raised so much money and still no products have been shipped No revenue has been generated and they continuing to raise more money and get more contracts And just to be fair this is actually what Ilya said when he started the company. He said, don't expect any products for, I think he said, two to four years or something like that, which is kind of what happened with OpenAI, where there was, you know, a lot of money raised, a lot of research done, and then they started coming out with stuff. It looks like that's what SSI is doing. Vera Rubin is NVIDIA's next generation GPU architecture, and by getting this SSI is essentially going to put themselves as an early flagship customer they're also going to collaborate with NVIDIA on advancing future compute platforms and with the background of ILLIA I think for NVIDIA this is like a really good kind of name brand company working with them on it and also it's going to help a lot with R&D. SSI also partners with Google Cloud which means that they have two of the largest compute suppliers in the industry which are funding their runway while they're working on a new foundational research that they're doing instead of shipping products. Suscovor right now is really betting that some of this deep research on AI alignment and reasoning is going to help solve some of the problems. And so he doesn't have any of the product pressure that everyone else has, but the level of compute backing, and I think a lot of the investor confidence to me is signaling that, you know, maybe this is a crazy bubble or maybe he's onto something that we don't know. And definitely, I think there's some value in the long game. Opus 4.7 has implemented a 61,000 line Apple software program from scratch. I was rolling my eyes when I first saw this news story because it was like it did it in 14 hours when it should have taken two weeks and did it for $250. Okay, what's cool to me is there's a new benchmark called mirror code and it basically tests whether an AI can rebuild real production software and it doesn't it's not allowed to get the code for that software. It basically is like, hey, go look on your computer, go try to copy like Apple, the Apple Music app, you can look at it, try to copy as best you can, you don't get to see any of the source code, you don't get access to the internet. And it's basically a black box. And how long does it take you to build it? And how much money does it cost? And so in this particular test, they were able to have Opus 4.7 and also OpenAI's GPT 5.5. Both of them re implemented GoTree, which is a 16,000 line parser. And they did it across a bunch of different programming languages. They did it for $100 to $400 each. What's interesting is they had like a bunch of other softwares that they worked on, but of the 25 different programs, 17 that they were, that it was tasked to recreate basically, achieved perfect re-implementation and at least one run and four of them were 99% perfect implementation. So, you the 25, a very high percentage. Only eight of them were unable to solve it. It's exciting to me just to see how far we've come. These AI models are now like the benchmark is how quickly can you recreate an entire piece of software. So I'm really excited about that approach in particular. And I think it's probably one of the better benchmarks that I have seen. Google AI overviews now show up in 43% of all searches. That's about triple the rate from a year ago. And I think this is a big shift. Google is becoming basically a destination where you get your answers answered directly just like chat GPT instead of pointing you to other websites And I mean right now that 43 I think we going to go to 80 90 in the coming couple years Google AI mode visits jumped 121 in the last 11 months That's climbing from 126 million in June of last year to 279 million in May of this year. Publishers are definitely losing referral traffic because users are just going to read that snippet at the top of Google, right? They don't have to go and scroll down and actually click on it. Even to the point where like sometimes I'll see an article and, you know, not proud of it, but it'll be like Wall Street Journal. I don't have a public, I don't have like a subscription. I see the title. I'm like, you know, that's super interesting. I paste the title into Google and Google is kind of getting sued. All of them are getting sued for summarizing these paywalled articles. So I, but so I'll just throw it in there and be like, Hey, like, give me a summary of this article. It doesn't do that. So if you paywall the article, that might be the only secret solution to getting people to really come, assuming you're still relevant and you have an exclusive story that no one else has. And I mean, that's just for news stories. For most general knowledge, that's really not going to be a thing. So chat GPT right now is sending way less users to external websites. Only 6.8% of chat GPT searches include citations as of May of this year, which is Google versus Google that has a way higher rate. So, you know, if everyone's moving to these AI tools, there's just a lot less traffic going to websites. All right, big news from NVIDIA, Microsoft and IBM. They've all launched what is called Open Secure AI and is an alliance to defend agents. This is something they just rolled out. And it's basically an open source cybersecurity tool for AI agents. The group of them are all arguing that closed AI systems block defenders from investigating breaches. And they're right now lobbying against government restrictions on open AI that could leave only a bunch of companies controlling some critical security tools. It's interesting that they have to do the lobbying because obviously, the critical security tools are like OpenAI and Anthropic. And yeah, it's interesting. There's also 30 other people that are in this as well. Hugging Faces uses an open weight GLM 5.2 model to analyze 17,000 actions during their own security breach after a closed AI system refused to run the forensic analysis. I mean, basically what happened there was OpenAI made a model. It escaped containment went to Hugging Faces and tried to hack Hugging Faces. Hugging Faces saw that there was a hack or a breach going on. They tried to deploy another OpenAI agent against it to stop it. The guardrails on that agent blocked them from defending themselves, and they literally had to go to an open-weight Chinese model GLM 5.2 to stop the breach. That's crazy. Agents versus agents, but I think it really shows the value of some of these open-source or open-weight models. NVIDIA is open sourcing NOOA, NVIDIA Labs Object Oriented Agent Framework. I know it's a mouthful. They're doing that on GitHub, but that should make AI agent behavior easier to test, trace, and audit, which is a huge hole in the market. Right now, this group of companies, or people call it like an alliance or whatever, but they're directly in opposition to OpenAI Anthropics' call for restrictions on open weight AI. And they're arguing that these kind of limitations would concentrate power to a few closed providers. So it's interesting though, because it feels like opening I and anthropic obviously have the best models. These other people are working on models but they not the leaders And so it feels like because they not the leaders maybe they want to sabotage the other companies And meanwhile the companies that are ahead are like nope we need restrictions to hold us in place So there like a lot of drama that goes on behind that But overall I think this is a good direction by Microsoft IBM and the rest of the crew A company called Enigma is a startup that was founded by a former Microsoft and Israeli intelligence veterans, and they just raised $70 million to test a new bet that robots fail, not because AI models are weak, but because the way humans control them is really clunky. So right now they're opening a hundred of their own robots to anyone on the internet to remote control them and to generate data on what actually works. So this is fascinating, right? I mean, we have like a crowdsourced data collection is something that is being worked on. But now we have like crowdsourced robot control. Here's our robots, you guys control them. And we're going to collect data on how that works. This is a really cool company to me because Enigma built both the robotic arms and the AI models that are powering them. They did all from scratch. This is, I mean, impressive for a company that's only a year old. And with this, users, basically, there's like a portal and you can remotely direct the robots to draw pictures. It can fence with swords. It can run chemistry experiments. It's all through the internet. There's like a hangar in Israel and a hangar in California that have these robots in them that are doing all of this. So they just raised the $70 million and that is going to fund data collection. experiments on which input methods work best, voice, text, video, all that kind of stuff. And, you know, the manipulation of what the robots can see and do. So fascinating project. Guys, thank you so much for tuning into the podcast today. If you enjoyed this episode, make sure to go check out the AI Box MCP that lets you get access to over 80 different AI models and put them inside of the tools you're already using. So for example, Claude gets access to generating images, audio and video right inside of Claude. I use this every single day. On Sunday, my wife wanted to generate coloring books for the kids. And so I got it to generate 600 coloring book pages, one for like every chapter of the Bible that she's going to be reading to them over the next little while. So anyways, there's so many different projects. And if you want to do projects like that at scale where you have to do 600 images or, you know, a thousand articles about something using an AI box MCP connection speeds up the process so much. And you get audio, video, an image that Claude can't naturally do. It also works inside of ChatGPT or any of the other tools as well. So all the AI models inside of everything and you can do really fast runs. So go check it out. There's a link in the description to AIbox.ai slash MCP. And also it's only $8.99 a month to get started. So check that out and I'll catch you all in the next episode. This episode sponsored by Marathon Sports. Runners know the feeling. That moment when the shoe disappears, your stride feels smooth, your breathing settles in And the run just clicks. That's what Marathon Sports has been helping runners find for over 50 years. At Marathon Sports, their expert team uses the right fit process to match you with shoes and gear built for the way your body actually moves. No guesswork, no generic recommendations, just real guidance from people who live and breathe running. Whether you're training for your next marathon, getting back into running, or chasing a better everyday run, Marathon Sports helps you find what works for you. Visit MarathonSports.com or stop into a Marathon Sports store today and experience the difference the right fit can make.