Hey, it's Oliver from This Week in AI, the brand new podcast from the team at Twist. We're dropping a sneak peek right here in your feed to show you what we've been building. If you enjoy it, join the community at thisweekinai.ai or find us on Spotify, Apple Podcasts or YouTube. Like I was talking to a friend of mine, she's an accountant and she told me accounting is never going to be replaced by automation. I'm like, what are you talking about? It's the first time we're really automating cognition as opposed to just automating the physical part of a job. 70% of them think they'll have a decrease in job opportunities. Only 30% of Americans are worried in the same poll about themselves. So they all think it's happening to somebody else. I do think that humans will want to play status games. I think we'll find other jobs. I think we'll probably be doing less numerical and logical jobs. It feels like something very big is coming. The world doesn't appreciate that it's happening because most people are not very good at asking questions. You can taste the singularity at this point. I can't even imagine the end of this year is going to be shocking. Thanks to our friends at PayPal, the exclusive sponsor for This Week in AI. Try the payment and growth platform that's trusted by millions of customers worldwide. PayPal Open. Start growing today at paypalopen.com. All right, everybody, welcome back to Not This Week in Startups, Not All In. This is a new roundtable I'm doing. It's called This Week in AI. It's in the name, folks. Every week, three amazing CEOs, just like on All In or the VC roundtable we do over at Twist, three amazing CEOs who are actually building the future. And me, an investor in the space and an entrepreneur, talk about the week's issues and sometimes the bigger picture issues. You can find out more about the podcast this week in AI.AI. Or if you want to see the YouTube channel this week in AI.AI.YouTube. And this is our seventh episode. It's March 31st, 2026. Three amazing guests with us today. Jeremy Frankel is here. He's the CEO and co-founder of Fundamental. They're building large tabular models for enterprises. They emerged from stealth as a unicorn just 16 months after founding, 255 million series A, led by Oak with participation from Valor Battery Salesforce. And more welcome to the program, Jeremy Frankel. So, Jeremy, explain what your company is doing and how it's going so far. Things are going great. So, what we are doing is we built a foundation model for tabular data. So, what does that mean? So, when people think about the AI boom or the AI revolution, everyone is thinking about LLMs. And for a good reason, right? Like, chat, GPT, like, create a breakthrough. You can now pre-train one model on the entire Internet and you understand language and you can use it to power thousands of use cases. But what's less appreciated is that LLMs really mostly solve unstructured data issues, such as, you know, text, audio, video, images, coding, but they really didn't impact structural data. And structural data means everything that comes in rows and columns. So, think about spreadsheets, databases, CRMs, ERPs. It's all rows and columns. And that's the vast majority of useful data for enterprises. And that part of the enterprise AI has never had its chat GPT moment. And so, this is the modality we're going after. And for a variety of reasons, it's the one modality that acts very differently than others. And what we're building is really the chat GPT moment for tabular data. So, if I can repeat it back to you to make sure I understand this vision, it's what I always like to do with founders, see if I can repeat it back. You have large language models. Those are built, as we all know, like guess the next word in transformers. It's based on massive corpuses of text-based data, generally speaking. You're building an LLM to focus specifically on tables and tabular data structures that we all know as a, you know, might experience an Excel sheet or a database, a Notion database, a SQL database. Am I correct? So, it's not an LLM. It's a large tabular model. So, it has a very different architecture than LLMs. Basically, if you look at the LLMs, as you said, they're built on your being next token predictors. It's an auto-regressive model. The problem with that is that if you look at the way transformers, for example, are applied to LLMs, they have a positional encoding as part of it. So, the order of the sentence model, right? Like if you change the orders of your sentence in cloud or changing P, you can get a different output. But with tables, you actually don't want that. And the reason why is like, imagine if you have a table with a million patients and you're trying to predict which one of them have cancer. And your first column has the weight of the patient, and your second column has the heart rate of the patients. If you switch the order of those columns and you first leave the heart rate and then the weight, you shouldn't expect or you wouldn't want to expect a different output. But with LLMs, if you change the order of the data, you get a different output. And that's fine when you're writing an email. It's not fine when you look at the deterministic outputs. And so that's what we've focused on. Got it. So, large tabular model and LTM is how they're first. Are you the first people to do this? Or is this like a known alternative to an LLM? It's very nascent. There are few smaller companies working on it as well, more in an academic environment, an academic setting. But we are the first large company doing that at an enterprise scale. What is the benefit here? Is it because you'll have a better fidelity, better results, more trustable results than the problem we have with hallucinations in large language models? Would that be the reason to do this? It's very different use cases. So, if you look at everything in the economy, for example, on every time you swipe your credit card, one of the credit card providers has to make a split second decision of whether the transaction is fraudulent or not. When you work with retail, for example, forecasting demand, all of those, or like for example, if you order an Uber, Uber has to make a prediction on the ET of your driver. Each one of those stars is tabular by nature and it's predictive. But when you look at the way those predictions are being made, they still rely on traditional machine learning algorithms, the pre-datal aliems. And those algorithms still do better than most aliems at making those predictions. And so what we've built is a model that can essentially unify all of those use cases into one model to allow you to make much more accurate predictions than what you would otherwise be able to make. Genius. So, the company is named fundamental and your flagship model, the LTM, large tabular model is called Nexus. Am I correct there? Correct. Correct. And we just had perplexity CEO, Aravind, who's really crushing it. He's one of your angels, huh? Correct. Awesome. Victor, Ripar Belly, I got your name correct, I hope. You did. Ripar Belly. Welcome back to the program, you're with Cynesthesia. Cynesthesia. Sy-n-t-h-e-s-i-a. You're an AI video platform for business. 90% of Fortune 100 companies are your customers already, over 100 million in ARR, and you've raised over 500 million, four billion dollar valuation. And we're seeing an incredible demo here. Explain to us how your different nano-banana, the free services out there, chat GPTs, image generation, and why you exist as a company dedicated to just working on video models. So I think it goes, we started the company in 2017, way before any AI video tech actually worked. So we've been quite a bunch of different companies all the way up to 2026. What we decided on five years ago was we're kind of looking at the early iterations of AI video, right? Which is the model that we're seeing right now, like Vio, Sora, which just being discontinued, our models. Obviously, very high fidelity, fairly inexpensive to run, assuming you're just like creating single videos and really getting to the point where you actually can't tell the difference, which unlocks a whole bunch of new use cases. But what we figured out five years ago was that the first iteration of this technology was not ready for prime time. They could definitely not make a Hollywood film, they could definitely not make performance marketing ads. But there was a very real use case in taking all the world's PowerPoint users and enabling them to communicate in video as opposed to slide decks or documents, which in 2022, when we launched the first product, was what everybody wants. People want to watch and listen to their content. They don't want to read that much anymore. And we essentially provide a way for PowerPoint creators to very easily switch to making video instead. And that has worked really, really well. And today, we both have our own models. We build voice models, we build video models, we have interactive models or avatars we can actually talk to in real time that's launching very soon. And then we also use a mix of the big models from some of the bigger providers to solve some word for our customers. And for folks who want to hear from you three years ago, we had you on this week in Startups as part of our next Unicorn series. Before you were Unicorn episode 1776. What a great episode number to have. Why did ChatGPT OpenAI shut down Sora? And why is Elon doubling down on video? He's been very vocal just this week talking about how video is the most important thing. Take us through your take on that. Obviously, you were in video years before ChatGPT was even launched. I mean, I think it's kind of interesting that you've been a company like OpenAI, found by like some of the smartest people in the valley, right? Like some of those accomplished people still had to learn the lesson of like focus. You know, it's kind of like I think it was like unteachable lessons, but they had to learn the hard way. I think it's very obvious to anyone looking at the way that I'm probably ripping right now that CodeGen is probably the most valuable near term use case for all these technologies. And I think OpenAI probably had a little bit of flying too close to the sun moment, but it decided to do like absolutely everything all at once, right? Which often the PowerPoint, it sounds doable, but in reality, I think I don't anyone who's run a business knows that doing too many things at once is like rally a really good idea. And fropping focused on no vice models, no video models, just like CodeGen, B2B, no freemium, and that is still paid off really well for them. So I think my take on what's going on in OpenAI is is that they're like, let's cut all the side quests and focus on the market that's really, really going to matter. And I think that's going to be probably screwing more towards B2B and it's going to be heavier on CodeGen and powering just this like campaign explosion of a product that we're seeing being built with the by quoting right now. I guess Claude's got people shaken. They've done or specifically it's got OpenAI shaken. They've added so much revenue. They've become such a darling. Jeremy, I see you smiling about this. This has become notable in the industry. Yeah, Jeremy? No, correct. And I mean, it's funny. I was at the founder retreat a few weeks ago and everyone was just talking about Claude Code. No one was mentioning anything else that Claude Code. So what founder retreat was this? It was a Lightspeed event. Oh, Lightspeed. Okay. The venture cowboy firm and that's fascinating. Nick Harris is back in this weekend family. You were on this week in startups. I remember this discussion August of 2023 as well, episode 1787. And so we got it right having you guys on early and we were talking about and you were predicting just how important, you know, these data center was these data centers were and that photonics using light instead of electricity to connect AI chips would be critically important. And you explained to me and pack on that program, Nick, that energy and data centers were going to be a major, major issue. And here we are three years later. Energy is the bottleneck, isn't it, Nick? Yeah, it's exactly the bottleneck. You know, as a company, we've been focused on driving the future of computing. The central challenge that we're solving at Light Matter is around how do you create a new roadmap for Moore's Law for denards scaling? These are rules that drove computing progress for, you know, our entire lives. I think about being a kid in the 90s and every 18 months, you get an incredible new chip, more performance, all these things. That's over now. And there's only two ways that computers get better at this point. One is big computer chips. You put more chips in a package. Computer chips are getting to the point where, you know, Nvidia sells nearly $100,000 chips. So those chips are getting really big and the size of the chip is going to keep growing. And the other way is that at any given time, there's a biggest chip you can build. So networking them together is the other piece. So big chips network together. This is the future of computing. It's the new Moore's Law. And we power both of these with our product passage. And we also, since we spoke last, started building lasers, which I never thought we would get into. But when you look at the photonics revolution, what's interesting is that you've got this device that powers all of the communication for these AI supercomputers. And it relies on the laser. It's kind of like batteries for electric vehicles. It's a really fundamental, huge part of the bomb. And it drives all the progress and how these computers are going to connect. You know, one of the cool things to tie into the software piece of this is with photonic technology, we've shown, you know, in research and so on that you can actually three X time to train. If you guys are watching Anthropic and they're incredible tear, I'm hearing about the new model mythos that's coming out. We can actually three X, three X faster time to train. Imagine if you have P e to the r t, where you've got our times three now. So the rate of takeoff is going to go up like crazy. The first companies that adopt this phatonic technology for linking up GPUs and a data centers, the foundation companies, they're going to have an enormous advantage. Got it. And for the audience, again, my typical technique of repeating back. So we all understand what you're doing, Nick's at light matter. Ethernet cables, that's how we connect computers. Typically, obviously, people are consumers are using Wi Fi, you would never use that because it's very limited bandwidth. But Ethernet, which is typically copper wrapped in plastic versus photonics, which would be made of glass, I'm assuming here, and fiber optics. Yes, and the throughput is radically different. Maybe you could explain, give us a bit of a primer, and then you could sportscast what we are seeing on the screen. Right now, the way that AI super computers are built, you think about nvl 72 from Nvidia, they take 72 GPUs and they link them all together in a very high bandwidth domain. So here we're talking about petabit per second bandwidths within a rack. That's all linked together in copper. What's really interesting about copper is it can't go very far. The cables have to be quite short. And so what you're seeing is the racks are getting packed as tight as possible. Now people are building racks that are a megawatt. So you have a rack that's a megawatt, you have to reinforce the concrete below it, because it's so heavy that it's actually a load on infrastructure. And you're building these custom racks that are just for delivering the cooling to these systems. That's kind of where people are at today. And the reason there there is you have to bring the density because the copper can't reach very far. So just to give you an example of the delta and what we do, we just announced a chip with Qualcomm, where with each glass fiber, we're packing 16 wavelengths of light. And we're pushing 1.6 terabits over a single optical fiber. That bandwidth is crazy. It's like 1600 houses worth of internet. You know, a normal house has one gig internet, so 1600 houses. So copper really doesn't have very much reach. And the reason it matters is when you're building these AI supercomputers, if you want to have great performance, you want to link as many GPUs as you can tightly together. If you have optics like what we do, you don't need to put it all in one rack. You can separate it by a kilometer. It travels at the speed of light. There's very little loss in the optical fiber. And you can build giant systems that act like a single brain, rather than a bunch of mini brains with 72 GPUs talking in parallel. You could have thousands of GPUs working together on a workload. It drives interactivity, drives time to train both inference and training, get a huge benefit out of switching from copper to optics. And we're kind of the leader in performance in this space. And just so people can conceive of a petabit, you're talking about thousands of 4K movies from, you know, coming from Netflix every second. So this and probably 100 million high-res photos from your camera, your library per second. So if you had 100, if we as consumers had 100 million photos somehow in our photo libraries, Victor, you could be sending just, you know, hundreds of people's photo libraries. The entire, you could send the entire corpus of Netflix movies in 10 seconds. Yes, Nick? Yeah, exactly. And there's a kind of a cool analogy here. We have the chip M1000 that we announced last year. That chip is 114 terabit per second. So that's 114,000 gigabit per second. That's 114,000 houses worth of bandwidth. And a more interesting comparison is that that is about the bandwidth of the cables that connect North America to Europe for the internet, the undersea optical cables. So we're building chips that have just an obscene amount of bandwidth. And it's all needed to drive AI scaling. Jeremy or Victor, have in terms of your data usage when you hear about light matter and the impact it could have, what goes through your mind, Victor? Obviously, you're working in video and your data centers, I'm not sure what your standard platform is and where you host, but maybe thinking ahead to the future, how do you think about what Nick is building? I think it's super exciting. So there's kind of two big ideas we found in Synthesia. The first one was like, as AI increasingly can generate data, the marginal cost of creating video, audio, all the other content has got dropped to zero, right? Well, the dollars, that was very much in time required and skills required. I think we're in the middle of that right now. But this is still video as we know it today. It's a broadcast medium. You make one video, you put it on YouTube, and everybody watches exactly the same version of it. The second part of our thesis was always around when we invent new technologies as humans, we always invent new media formats that are native to those technologies. Like they have a podcast or TikTok video wouldn't exist without modern technology. And for us, the big question is like, what does video look like if you were to reinvent it in 2026 with all the new primes we have around us, right? We have LLMs with essentially intelligence on tap. We have offline video models that can create extremely high quality content. We have real-time video models that you could interact with, advertise, you can talk to, can investors that can be drawn in real time, and a whole bunch of other like cool technologies around it. And so what we're building for and what we're actually launching, it's in private beta right now, launching in a couple of months, is real-time video, which is the idea that if you, to take one of our use cases, if you're a salesperson and you're doing a bunch of training to understand like the competitive landscape and the product that you are launching, instead of just like receiving a video that you sit down and then you watch it and then you hope you understand it, it's got to be an interactive experience. It's got to be maybe first you consume some content, you go into an agent, you role play with it, it pretends to be a customer, you have to answer questions, overcome objections, then you go to another thing where we actually in real time draw a diagram of a customer's potential tech stack, how you got to work with this, how you got to integrate it. That's a very different type of video, which is almost like closer to maybe like a game or like a website or something like that. But one of the bottlenecks here is of course that if we're actually going to do this with video and we're going to do the like avatar models and we're going to draw things real-time, that's going to take up a lot more bandwidth. It's also going to have much high inference costs. And so the more we can reduce these, the more accessible this becomes. So I think in the next couple of years we'll see this becoming a new type of interface that's going to emerge, but for it to really take off and just be you know, every interaction we have with the computer could be done with technology like this. We need the cost of serving that content to drop like very significantly. I think that's the core of what Nick's working on. So I think it's very exciting. Nick, when we have this ready for Victor to experience it and like it's, we could probably do a deal right now that he could be one of your beta customers because it would be amazing for Disney. I mean, I'm thinking in a consumer mind frame to sort of help the audience follow along here, but imagine you know, Disney releases Mandalorian and they had done a deal with Sora to try to get the IP to work. Now imagine with Light Matter being able to enable Victor's company to be able to make a short film with Grogu and the Mandalorian and you're talking to them in real time and it's making that in real time. That's just, yeah. Yeah, that's absolutely awesome. On economics on that, right? I think, you know, if you were to do that today, let's say you were to like personalize like a one hour movie for a kid from Disney, like that would cost you like a lot of money, right? If you say like an eight second clip with like a state of that video model costs like one or two dollars today, you're going to add that up for like an hour of eight second clips, right? That's not going to be sustainable within like a $15 per month. It'll be, yeah, for $6 a minute. If we just made it like six bucks a minute, 120 minute, you're talking about $700 for a custom movie that you can live in. Exactly. And we're not that many years ahead of like, I remember I was a kid, right? And I had to like call my dad and ask him if I could download like a 10 megabyte file because it was like ADSL and you were like mirror how much you would download. The idea of doing a video call for an hour with someone across the world, like that's an after the ludicrous idea, right? But probably in like X amount of years, this is going to be like completely normal. We're going to be just generating content in real time in front of people and we're going to be able to offer that at like, you know, within the subscriptions that these services charge today. Nick, you were going to address your analysis. Yeah, we're actually busy building chips for a bunch of companies. We typically work with hyper scalers to build their own chips, think about like the Google Amazon, Microsoft, Meta type companies who are building their own hardware to do both training and inference. And then we also work with semiconductor companies, both GPU companies as well as networking companies. So those are the people we build for. We're building a ton of chips right now. So I would say in the next, you know, year and two years, you're going to start running on light matter hardware. These will be in the new data centers. Think about like the Texas stuff. Yeah, what's the one, not Star Bay Stargate, another great film, speaking of film. Yes, excellent film. Yeah. And so there's a picture of, I think that's Stargate. And what you see in the middle is that plus, I think, is, I think I was talking to Jensen or the CEO of CoreWeave about this. Somebody on my team will tell me, I believe this is CoreWeave's data center. You have the cooling there, that bottom line that looks like memory chips in a motherboard. These are starting, these data centers are starting to look like giant motherboards. But I think those are the cooling apparatus where the contained water system, what do they call closed loop water system? Yeah, closed loop water system. So that was Crusoe's data center. I remember the CEO was walking me through it on a previous episode. That's the closed loop water system and the data exchange. Pretty compelling stuff. Jeremy, when you look at all this, oh, by the way, Nick, Amazon making their own chips. And I don't know if they're a customer, if they were, you could say so, but you gave us the sort of like Amazon's are called Tranium for training AI models and Inferentia for running inference models. Somebody at Amazon needs to go to branding school. That's a little too on the nose. Tranium and Inferentia. I mean, what did they do? They asked ChatGPT to come up with names. But these are going to be dedicated chips. And I think Broadcom generally builds people their chips. Is that typically what happens? So if we explain it to the audience, you have NVIDIA, they work with TSMC, they're making their own chipsets, they're the leader of the pack. Every single other hyperscaler, tensors from Amazon, tensors from Google, then you have these Inferentia, Tranium, and MTIA from Meta. So explain to the audience why people are doing two different supply chains, Nick, and then we'll get to you, Jeremy, on your thoughts on this next wave, how that'll affect your business. If you look at the incredible spend, I mean, they're over 100 billion a year. They're like 180 billion a year, I think is what Google announced they spent. I think Amazon was over 200 billion for the year. When you're spending that kind of money, developing your own custom silicon is a little bit of a rounding error. So I think that they're really looking at these costs, they're trying to figure out how they can optimize cost, and they think they can build their own solutions. Now, building a chip is one thing, but building all the software in the ecosystem around it is another, and that's where NVIDIA has had decades of experience building out the moat there with CUDA and everything. But everyone's trying to build these chips, and the reason is that it's a race on the infrastructure point. People are trying to get power, they're investing in these micro nuclear reactors to go power the data centers, 100 megawatts each. So you get 10 of those and you've got a gigawatt data center, they're working on that power delivery, they're working on building the chips, they do their own, these hyperscalers are becoming very heavy duty infrastructure players from cement to energy all the way to chips, and obviously the software stuff on top. There's just so much money in this space that they're all making the bet on doing it themselves, and it's all in service of powering technologies like Jeremy and Victor's. It's really about the apps that run on top of this and getting the cost to the right point, because the AI models are incredible, but we've got to keep driving down the token cost and driving up the inference rate, and then we'll be able to keep unlocking incredible things like, you know, custom movies, and you're going to need blazingly fast interconnect for that. Jeremy, I'm assuming you're building on CUDA, which is the proprietary layer for coding and sending jobs to NVIDIA hardware, correct? Correct. And if you were to consider other platforms, other hardware platforms that were non-NVIDIA, have you considered that, and is there a path for you, or would you have to maintain CUDA plus some other open source software? I guess there's some abstraction layers for CUDA now to get on AMD processors. So as the CEO, how do you think about where to spend your energy? Is it just too much to even consider other platforms, or are you like Amazon, Meta, and Google saying, hey, we need to have two swings at bat? I very much think that, you know, we have in the process of exploring different chips as well. You mentioned Tranium, it's one of the chips we're in the process of exploring, and the idea here is that we don't want to just be dependent on one hardware or one type of chip. Of course, it comes with, like, CUDA gives you a lot of advantages, and it's not easy to switch away from CUDA, but it's definitely something that's when the process of exploring and what NVIDIA is doing is really exciting, because the funny thing about everyone knows, but with video, but the amount of data that is being moved from one place to another. But people also don't realize that you have the same problem with tables. If you think about a table with 10 million rows and 100 columns, which is not that big of a table, right? It's like, what, you have like a billion cents? That's orders of magnitude more than the context the largest LLMs can even take in, right? The largest LLMs can maybe take 100,000 rows, but when you're working, for example, with banks on fraud detection, you're working with billions of rows. So you just need, and they're like, millisecond matters, right? You make a decision, like, when you start your crack out, you don't want to be waiting for 10 minutes before you get an answer. You just want to get an answer right away. And so the amount of data out there in tables is just massive. We've been talking to a few companies, but I think that every IoT sensor, every time you get some data, that comes some form of structure fall. And the amount of data that they are dealing with is like petabytes of data. And so being able to move data much faster and having a lower latency, as Nick said, also lower cost will really be essential. Yeah. I mean, if you were to think about, I have these error things, I don't know if you guys care about error quality in your homes, but it turns out like in your office in your home, like CO2 and radon, all this stuff, very important for health, very important for like cognitive function, especially CO2. So I have these error things. It's taking recordings in six rooms and three different houses for me. The amount of data that just one person consumes, or let alone your whoop or your fit, correct, like how many heartbeats is whoop and shout out to whoop, they just raised money at a $10 billion valuation. Like, what's the data processing there when they have to do my sleep and my recovery and my run and my heartbeat? I mean, my Lord, it's huge amount of data. Exactly. It's unfathomable amounts of data. Join the community at thisweekinae.ai or find us on Spotify, Apple Podcasts or YouTube.
