Introducing 4D Creation Open Beta: NPCs, 4D Worlds, and the Future of Gaming with Roblox CEO Dave Baszucki

What proportion of you think your children will have at least one serious relationship with an AI throughout their lifetime? I think zero right now. I don't think we're close to crossing the human AI barrier, but it is worth thinking things are changing every day. We have to incorporate and do that. And then there's also some weird universal truths of things that stick around for 40 years and kind of have to blend them together. We feel if we build Roblox right, it might be the kind of thing that's kicking around in 40 years. Hi listeners, welcome back to No Priors. Today, Alad and I are here with Dave Bazzucchi, the founder and CEO of Roblox, the 3D immersive world where more than 150 million users come every day to hang out. We talk with Dave about the future of AI in gaming, their investments in AI, how NPCs are going to change and really transform game. Roblox's studio, one of the largest coding platforms out there, and their 20-year mission to build the holodeck. Welcome, Dave. Dave, thanks so much for doing this with us. It is so great to be here, and thank you for doing this in Roblox headquarters. How exciting to be here. Yeah, great to have you guys. Thanks. So I think we wanted to start with a big picture question. I think you all have been really visionary in terms of where all this is heading, and AI is obviously having a big wave and effect on gaming and what's going to happen in the future there. And that's across things like world models. How do you think about NPCs and their evolution? How do you think about assets within games? How do you think about world creation? So we'd just love to hear your views of big picture. 10 years from now, where are we going? What's coming? So two-step on this one. I would say first, I know you both dabble in investing a little. So there is a Roblox business plan PowerPoint deck from almost 20 years ago that we pull out sometimes and we're amazed at the fidelity of it. It pretends a new category. One could call it the category of human co-experience. It's got the sizes of a bunch of companies from 20 years ago. So you can see social networking companies, you can see YouTube video, you can see toys, and you can see all of that. And what it imagined is really a new category. Some have called it the metaverse. Some have called it the holodeck, which is really the ultimate high fidelity simulation where people can come together and do stuff. It's like a ready player one, the movie. Exactly. And so we do have that business plan slide. And what we had always imagined is if this high fidelity space was backed by physics simulation and reality simulation, you'd be able to do stuff. You'd be able to build a car, put wheels on it, drive it around. You'd be able to go to a birthday party and blow out the candles. You'd be able to chop trees down and make a house of it. So that was literally the genesis of Roblox. And here we are 20 years later, there's so much more to do. But one vision of AI is how do you superpower the creation of that holodeck? And how do you get it photorealistic as soon as possible? How do you get 10,000 people in it instead of 100? How do you do acoustic simulation that sounds realistic with 10,000 people? So in that sense, AI is super interesting about just trying to get a vision that's been around for 20 years and has arguably been in sci-fi, once again, Snow Crash, Holiday, forever. There is another interesting vision. And I think it's useful comparing these product things as much more. What's the future of just a single person by themselves dreaming what they want to dream? And we sometimes call that real time dreaming category. It's a category that we can see a bit of trappings of with short form video. There's a little bit of that in short form video. You know, someone's 2am in their bed doom scrolling, it's reacting to dwell time, it's reacting to what you favorite, and you're kind of getting a little bit of a pre-built dream. That I think we sometimes imagine could go all the way to the famous Tom Cruise movie, Vanilla Sky, where he literally real-time dreamed for several years in an imaginary universe where everyone around him was primarily an NPC and he didn't even know he was doing it. So that's more world building as content. That is exactly right. And so if you put those at two extremes, one is communication platform, high fidelity with people you know, the other is real time dreaming where everyone's an NPC, everything in between is possible. And I think we see everything in between ultimately as being possible and we may see weird product categories we never imagined you know i i think people are probably thinking does the text prompt turn into a voice prompt and does it automatically turn into a video prompt if there's like i want to learn french video how you're in a french cafe start talking to an npc so i think i think i think there's a wide range of products that start to get into the space we're interested in, which is kind of that 3D reality space. Do you think that same space will exist for both consumer and business applications? Because people also talk about this in the context of, instead of doing a Zoom, why don't you go into a shared space with someone and meet with that? I think- What degree of your life becomes virtual? Yeah, we have seen, I think on the communication side, people just want more and more fidelity. We can go back to paintings on the wall of a cave. People want more fidelity. We have smoke signals. We have the mail system. We have the Pony Express. We have the telegraph system. We have the phone system. We have arguably the COVID-initiated video. We also did have the COVID-initiated 3D experience on Roblox, actually. And we found side-by-side video. A lot of young people use Roblox as an early test case of how to co-experience. I think as the technology for multiplayer 4D simulation gets better and more photorealistic, it's almost going to be like video is the downsampling. And it's like if we were having this 4D immersive communication, we'd say go to legacy analog mode and make it look like Zoom, basically. And we could always do that. But we'd be able to do things we could never do on Zoom. You know, you'd say, hey, let's pop up and go walk around my office and I want to show you something. Come and follow me kind of thing. So I do think the 4D simulation, as it gets photorealistic, will be a superset of video. The other thing for business is there's a few things that 4D, and I use 4D because it's not just 3D shape, but it's function in a way, will provide that video does not provide is acoustical things. And there's some real tricky physics problems when you're having a company meeting of a thousand people. If we try to do it on Zoom, we have like a bunch of squares. What's who's live? Who's not live? How do we mix the sound? Which is very tricky. If we do it in a three dimensional simulation, I can hear everyone with attenuation based on how far they are. And it can actually be a much more natural experience. Like I walk closer to you and I hear you. And that may actually be a better human interface paradigm. There's one final technical thing that's going to be very, very difficult is when people try to sing happy birthday to you together. And because no matter whether you're on Zoom or whether you're in a 3D simulation, you're hearing them like 30 milliseconds later. So what I think we're going to find is people are actually allowing each one of us to sing happy birthday with a time forward extrapolation of each other and then remixing it. So I do, you know, for the business side, I do think ultimately we're going to see some interesting conferencing solutions. Roblox has this amazing wild story with physics simulation or physics engine as like part of the birth of Roblox. But then today or for the last decade, I think of this as an immersive world where people have their first coding experiences. They build amazing games. They interact with each other. I don't think of that world as being super focused on realism. That's right. So is that something that's changing for you guys? Is it enabled now? How should we think about that? I think the way I would think about it is we're pushing really hard on the physics simulation capability. and at the same time we have this incredible free market that we can't control on content generation i would say we are just started talking about full acoustic simulation i just tweeted about it so actually you know approximate you know attenuation and all of this kind of things and echoes that's going to start happening on the physics simulator it's behind the scenes gotten better and better and better it'll keep getting better but what we have found i i would say is the diversity of developers are beyond our expectation. And I would say some of the things that have gone viral, Dress to Impress, for example, Grow a Garden, are less physical, but they have leveraged cloud capabilities that we've built side by side. Grow a Garden was essentially able to build an experience where things keep growing, even when you're not there, by leveraging a lot of the cloud persistence we provided. Dress to Impress was able to do some very interesting things with how they run contests and layer clothing on. So I think we're generally, you know, the specification for our product could be, we just want to simulate the real world with 10,000 people. And the more we go in that direction, the more we'll just see creators using it in different ways. How much attention have you been paying to world models and what's been happening in the AI world in terms of how people are shifting, how they do physics simulation, right? I think we're really watching it. I think that the biggest thing we have focused on and I think we'll continue to focus on is how do we get that 10,000 player multiplayer type experience? And how do we fall back to 100 or 10 or one? We feel it's super robust to build a communication platform. And that's part of our goal of getting to 10 of gaming The technology for this I think we gonna start unraveling it over the next five to ten years is what the most efficient way to synchronize the state of 10 000 people and and when we infrastructure problem versus necessarily a physics simulation how do we synchronize the state and the memory over the last five hours of 10 000 people where have they been Where have they been in 3D space? What have they been doing? The world model thing is very exciting because they're storing memory in literally video latence. You know, a minute of frames. It's showing super early promise. I think the technical revolution is going to be what's the ultimate synchronized state for 10,000 people? Is it in video latence? Is it in much more native 3D format? Is it a hybrid new discovery of some 3D video latent space to be determined? I will share that the format we're using, part of the vision for us is to ultimately store the history of everything on Roblox and to store it not raster like video, but store it vector, which means the ability to play back anything that's ever happened on roblox that's 13 billion hours a month um and so the ability what do you think that does for you the history of your world um so there's a there's a sci-fi book by arthur c clark called the light of other days which um talks about the fantasy of what would happen if we had infinite playback in our world it's like a real social problem um because if everything we've ever done can be played back. Actually, in that sci-fi book, it's not just everything could be played back, but you could look at any playback. And so everything's completely transparent. There's no private conversations. It actually delves into that. I think for us, we would then use it very thoughtfully and privacy compliant and judiciously. But for very simple things, you can imagine, oh, there was a safety incident. Let's go back and put five cameras and listen to the audio and see what happened and make a good judgment call. That's kind of interesting. There's a really special thing that maybe I did with someone in my family that's really special. Given I have access to my history, go play that back and possibly because it's 3D vector data, not raster data, reshoot it from it, make a cool video of the best moment. And I think where it ultimately ends up for us is there's a huge push now for people to find kind of hybrid video asdw human interaction data people are starting to train on video with keyboard stuff and like where do i find 200 million hours of this data the data we have which is 13 billion hours a month is can be reproduced from any camera angle and can interact with the 3d space so it's very powerful data it leads to a really interesting computer science program idea around how to create great NPCs that are more than just an LLM. Okay, tell us more about that. Actually, that sounds really interesting. Yeah, go check out on XRX feed. I think the last day or two, we released a bunch of native video demos and maybe we can even play them back here. But what we are starting to train is NPCs based on a combination of all of the data we have in a privacy compliant way that are starting to navigate and starting to play games. The challenge, I think, would be challenge level one. Everyone has access to an NPC that can get pretty good at playing any Roblox game. Challenge level two is by watching, if I still opt in in a privacy compliant way, my behaviors, the way I act, literally my gestures, the way I look at things, the way I talk. Would we allow you to have your own virtual doppelganger if you wanted? That's fascinating. And then number three would be is if I have a good virtual doppelganger, just as agentic is all the buzz in other areas, is there a simple user interface for agentic virtual doppelgangers? And that starts to get interesting because one could imagine sending their virtual self out to go do something. It could be, you know, my son or my daughter wants to play with me. I having to do some work. Could my virtual doppelganger fit in for 15 minutes? Sure. That's great. That could be really interesting. And there's a lot of other things, just like we're going to see a genetic space in the 2D and the workspace and the productivity area. I think it's going to be interesting to imagine. So you're basically using these 18 billion hours a month to train. 13 billion. 13 billion. Yeah. to train a native NPC model. That will be a Roblox privacy compliant model, never share the data. And then over time, no ship date, make that customizable as your own virtual doppelganger or for creators with the addition of a prompt, you know, upload Benjamin Franklin's history or it's already embedded in an LLM and just say, hey, I want Ben Franklin. Yeah. And I want a happy Ben Franklin. Are there experiences that you imagine creators making with these NPCs that are really different? I think there's a lot of standard game NPCs that I think have done such a good job. I wouldn't claim when these types of NPCs would be good enough. But like Grand Theft Auto, right? They've been working on this forever. That is a very rich world with a lot of very high performance, you know, NPC behavior. Imagining someday many people can create them. I think to make that happen, these platforms have to be very cloud connected platforms rather than running local to spin up inference on all of these things. But you could imagine that you could imagine a very young creator. saying I'd like to build an American history thing where you go and talk to Benjamin Franklin. So I think we would want to enable both of those. It's really interesting because basically the transition is going to be a poor analog, but there's a transition that happened in self-driving. We went from mapping out heuristics and sub-behaviors and sort of fine detail to capture edge cases to just doing end-to-end models for deep learning. And it sounds like you're basically considering doing the same thing for NPCs. I think that's the exciting computer science capability is rather than all of these wonderful techniques people have used, decision trees and this and this, getting to a purely more general modeling solution would be really fascinating. That's super interesting. What do you think the role of a Roblox game designer or any game designer is five years out from now? Do you think it's different? I think I'm optimistic that typically industrial revolution or whatever revolution, I think we've chatted about stuff like this before. There's a thought that there won't be any jobs after this. I think I'm a little bit more optimistic that a new class of things will show up. And I think there's a huge opportunity for more creators. I think, you know, I'm not to the point where I believe, you know, what we call AI slop today is going to take over. Like, I think the human touch has got a long runway on it. So you can imagine more diversity or quality of experiences supplemented by AI. But I do think the role will be more leveraged and the quality coming out of five people will be astounding, you know, but we'll come to expect that quality. So quality will go up. I think iteration on testing will go up. I think where we see platforms like Roblox going is just as people are starting to spin up agents to develop code. I think people, hopefully on the Roblox platform against the Roblox cloud, you'll be able to go away for 24 hours and your agents are going to be like tweaking and testing, spinning up a Roblox experience, sending 20 NPCs into them on various client emulators. There's an NPC on a phone. There's an NPC here tuning the game. So hopefully you'll feel more power in what you're building. I'm also curious, there is a set of research around world models, and I'm sure you've seen, that is just trying to directly generate game experiences with like, there's no physics engine underneath, like you don't control the mechanisms, it's just video. What's your view on that? I think it's like a super exciting, interesting thing to think about. I think, like I said before, I think one thing is going to be the higher the fidelity is memory stored in video latents. Or does there need to be another research breakthrough where memory is ultimately stored in some new latent space that's 3D or four dimension? But the fidelity is amazing. I think that's really beautiful. And I think that the way we would see the ultimate architectures of these platforms is probably for a while not an all-in-one thing. We would probably see some hyper-efficient thousand-person synchronization state engine. We might also see some of the photorealism not being done server-side, but being done in intermediate spaces or client-side as well. And we may see multi-step pipelines where there's the raw framework, there's 3D upsampling, then there's local 2D upsampling. We're actually going, oh, my gosh, like people are putting together a bunch of pieces, you know, dedicated NPC capability, dedicated synchronization capability, 3D upsampling, 2D upsampling and potentially world model stuff. World model, you can imagine that being used even in its early state today rather than maybe a gameplay state where rather than making a video, you talk about the video while you walk around. And you kind of say, put me in a Western world. I want to go left. I want to go right. Add a few horses. And that video actually goes to a multiplayer experience One could imagine that I think what a lot of other people are wondering is the short form video Does someone hit it just like they did with short form video into a highly retentive like local dreaming product that can just react to what you're doing? I think it's still early for both of those, but it's a big possibility. I would say that we are doubled down on a hybrid multi-AI tech stack that supports multiplayer natively. Yeah, I think one of the ideas that's like internationally very interesting has been the idea that you can generate like serial micro dramas as a form that is not yet that popular in the West, but seems like a good format for the technology. Microdramas, I've watched a few. I mean, it's really interesting. You know, it's fun to see like some entrepreneurs tried to do that. I won't mention who like five or 10 years ago and then they naturally emerged kind of thing. it's interesting to think if those micro dramas are easier to produce they don't need live actors but you know what is the plot line that really resonates you know we'll we'll see with that and you can mass test that at scale if you're using ai right you can actually that's right you know a very large number of iterations this is kind of one of the arguments people make around the for me paradox of like why haven't we seen alien life and the idea is it's just there's alien life are just stuck in these virtual worlds now where you know it's funnier than the real world like what's the famous quote where is everyone yeah exactly so one option is there's some virtual landscape that's more compelling than the real world and therefore there's no reason to travel the universe or it could be you know we we could really start conjecturing what's the future evolution is it human or machine life and all of that yeah and once it gets to maybe human machine life what happens so yeah this assumption yeah yeah that's a yeah interesting yeah that's the vanilla sky yeah exactly or the optimistic thing is more the holodeck thing like everyone's hanging out with other people rather than a simulation of themselves yeah are there experiences that you imagine from a like a communication or a social perspective that um you think are going to be just different or new or that you're going to have real insights into from these like really great NPCs right because I'm sure you've seen what has happened with the rise of AI companions and how engaging they are given they're just text interspaces there's some fun things that like there's a black mirror dating episode I don't know if you've seen it where they have they have a lot of virtual doppelganger power and obviously I'm not some Roblox is not doing dating we're just talking about this right now, you know, blah, blah, blah, 18 plus ID verified, all of that. So let's not go crazy, but let's think about a future in the Black Mirror episode where you literally can spawn the life of a thousand virtual doppelgangers. That thousand virtual doppelgangers, you're on your new dating app in three minutes. You know, someone else's virtual doppelgangers live a thousand virtual lives with your virtual doppelganger. And then they say, what's the success rate and when the like the thousand virtual doppelgangers say 98 percent of the time we had a good life then you say oh we should go on a date or something yeah so there's um like social simulation there's a lot of things we i think are going to be really hard to project i think one of the things we would focus on is the more we can just build raw high performance infrastructure, have AI as a service, have all of these things capable in a cloud, have the same thing run on a phone as a computer, have it auto-translate. Hopefully, we would discover some of these things. Yeah, I'm really optimistic about that, given the engagement that people see with these companions as just a text interface with the beginning of memory, right? Absolutely. If you're Roblox, you have embodiment, you have, as you said, cloud persistence. That's right. It's just going to make the characters much more interesting very quickly. Thinking through how we would embody memory for NPCs, which is more than just a prompt. One could imagine any NPC on Roblox, because we have recording of the whole thing, they actually have access to everything they've ever said or done in a very lean format. So they can go back through that, retrain on that. So that hopefully would be a native part of the platform. But I do know, yeah, there's a lot of interesting engagement with these types of companions and imagining fully 3D versions will be like pretty fascinating. Yeah, a friend of mine basically asks at dinner parties, he runs a well-known AI company, and it's sort of controversial question for the group is often, what proportion of you think your children will have at least one serious relationship with an AI, like throughout their lifetime? I think zero right now. I do. I don't think we're close to crossing the human AI barrier, but it is worth thinking. He meant it even in the context of like, even if it's superficial and there isn't true intelligence behind it, just given the behavior with text, once you start having video virtual worlds. I can imagine a real-time coach therapist in your earbud just hanging out all the time. Yeah. So I think for that kind of less evasive or over-your-shoulder coaching, I think that seems like... That's already a major use case, it seems, for some of the... Like JotGPT and other platforms where mental health advice or coaching or other things like that are actually one of the major use cases. Yeah, I think that will be arguably very valuable. Can I ask an industry perspective question, just given you've worked in gaming for a very long time? now. Why do you think like there's a lot of discussion about how assets of different types are cheaper to create with generative tools? I don't think that's really changed the dynamics of the gaming industry yet. I don't know if you would agree with that claim or explain it. One could say no matter how cheap it is to create assets, the expectation of quality from consumers goes up at exactly the same velocity. And so, you know, what was not possible a while ago, So the expectation of consumers will go up. I think there's a general notion that the technology for the gaming industry has to move to cloud vertically integrated. And asset management can't just ship on a DVD or be a giant download. I think we're really seeing we've launched dynamic LOD for textures, meshes on the way. So you can imagine every single asset in the game, sound, 3D object, image can exist in various formats. Traditional format is it's like a texture or a mesh or an audio file. future format could be it's an ai prompt and it's generated procedurally on demand so there's these two things they're both very ai enabled one can then imagine that you have to be cloud connected because for all of these assets you know a full range of lod just like with video streaming up sampling on low-end devices you need low lod high-end devices need 4k lod and ultimately on-demand AI generation. That then gets into, once again, one of the demos is probably on 3D upsampling. The notion that if someone makes a very primitive experience on Roblox, they would augment it with a prompt and they just say, I know it's kind of primitive, but make it kind of look medieval and more realistic and have all of those assets auto upsample in 3D in the cloud for free on demand. That kind of just-in-time thing is some of the stuff we're thinking about how AI can accelerate if you have a cloud platform. Roblox is also, from the Studio perspective, one of the biggest development environments in the world. That's right. What are you seeing from the perspective of AI coding there? Yeah, so this is great. So once again, industry standard ways of using a different model with Studio. So if you're in cloud code, you can control studio is super exciting. And so a lot of our users have started gluing these things together with the hope, ultimately, you know, they can build stuff from there. Roblox Studio itself is running a native assistant as well and a native code engine. And I think the pattern for that is Roblox Studio will more and more for code follow many of those industry best practices. but in parallel needs to have kind of an environmental generation kind of component that's very unique to that. And I think the future of environmental generation is, once again, any prompt you can imagine, text, image, video, possibly walking around in a world model to define a world, having iterate on that, iterate on that to a primitive 3D skeleton, do I like it? and then iterating on that to a fully functional game. So as that, I think that's our vision is to run those side by side. So first time studio user gets it out of the box. At the same time, we like plug into all of your AI workflow. I think the final thing is because it's so cloud connected, that thing we talked about earlier, spinning up jobs, spinning up agents, running test plans, kind of keep grinding away, trying something different is like you have all of that cloud capability. Just out of curiosity, what is the cycle of development for a successful Roblox game? What we have seen is over the years, bigger teams so that the top Roblox creators now are well into the 10s and 10s and 30s plus million a year. It's really serious stuff. We have seen in the Roblox creator community, I think, a healthy sign that creator number 1000 and what is their average yearly revenue is going up faster than creator number one. So that's a bit of a healthy long tail. And I would say all the way out to creator 1000, there's such a huge community of people making a living. What I think our creators have found is it's gotten both more healthy, but more competitive. and I think we've seen the pattern now of much more live ops in that because this is cloud, you can update your experience just like good websites every day or every week. And that is just kind of a constant practice So I say update frequency much more rapid Which is great for users because they get updated content at a faster rate That right Users love updates They love new things It keeps games fresh. So I think the other thing we have seen, we've, on the discovery side, we've tried to, and more and more, taken the approach we want discovery to be completely transparent. Like these are all the things that are going into the discovery algorithm, we check it. There's a benefit to that transparency and discovery and that it actually keeps a lot of pressure on us. You know, oh my gosh, someone's going to game discovery. Well, then we better make it really good, right? And transparent. I actually think transparent discovery and recommendations is an interesting trend for the industry, worth talking about. But so with that, We have seen also the kind of the content distribution get richer and a little bit less spiky. There's now like the top 20 experiences on Roblox are all really good and all kind of vying for the number one slot, which maybe wasn't so true three or four years ago. Zooming all the way out for a second, I think it was true five or 10 years ago when we met. It was true when I was talking to one of the members of your leadership team today. They will say you're a extremely high conviction, very long term oriented leader. Right. So, you know, 20 year plan for Roblox and we're going to do things the way we have a vision toward. You're obviously also all in on AI. Right. Very excited about the technologies and investing in them. How do you like square these things where you have a very long term view when so much is happening in the environment? I think we we always want to pair take the long view, which is one of our four big values with get stuff done. And so it's almost like in those old Gartner charts, you know, take the long view, not take the long view, get stuff done, not take the stuff like the magic quadrant is take the long view, get stuff done. And we typically mean inside the company, rapid iteration. And so if someone has a view of some exciting new product and we're going to ship it in six months, that can be a very scary thing unless it can be broken down. They're like, we're going to ship this thing every week and iterate towards this. But we have a good target of where we're going. And so I think inside the company, we, I'd say our AI team, our facial age estimation team, our safety team, these are literally things working on a weekly basis, which allows a fairly fast reaction time. AI, I think, is arguably, as far as speed right now, just every day. But you mean you make it sound pretty simple in that, like all the things that you're trying to get done on a week or a six month timescale, they're all aligned toward a vision that isn't really effective. If you have your six to 12 month vision, hopefully that's moving not too fast. But at the same time, the weekly iterations are moving very quickly in that direction. And, you know, that you could say the Roblox vision is ultimately to build the holodeck. and it's 10,000 people, it's multiplayer, real-time modification of the environment, it's NPCs, photorealistic, that's a pretty stable spec for 20 years. And so then... I actually feel like that's the biggest takeaway for me here. I spent a lot of time with software CEOs, right? And I think there's a lot of actual concern about, is the vision we had for the company in terms of its durability or its value still as valuable as we thought five years ago. And for Roblox, perhaps because you were pointing at something so far away to begin with, it's pretty clear. I think we have crisped that up over the years. I would say two years ago, we were a little less crisp. We would say, we're going for a billion DAUs. That's a good spec with this spec I just mentioned. It's a little harder to operationalize around product management teams and that. So we took a stepping stone and said we want to get to 10% of global gaming content on the way to that. It's actually a remarkably good step. It's about 300 million DAUs. It's about 20 billion. It's about 3x where we are. It can be forensically torn apart. We can see what part is the USA market. We actually have a higher target for US than 10%. And so that has been very clarifying. I think for a software CEO, always knowing both 3x and 10x is very helpful because if you don't know 10x, then it's hard to sleep at night. If you don't know 3x, it's hard to plan forensically how we're going to operationalize that, how quickly we're going to get there. One other thing that I think that Roblox has done uniquely well is how you've thought about hiring and how you've rethought certain aspects of that. And I think that's really led to people who have more bias to action, who are moving quickly, who are iterating rapidly. Can you talk a little bit about how you've rethought some aspects of that, if you're willing to share that as part of it? Yeah, I mean, one is we've been very public that we really want values aligned people that are good problem solvers, that are very creative. And it's hard to do signal to noise and that kind of a hiring thing. So what we actually bought a company about five years ago that was doing their best scientifically to build 3D assessment tooling for some big companies to really find people who are problem solvers and creative. That's part of what I was referring to. I think that was fascinating that you get that acquisition. So we bought Embellus. We got a great team of scientists, people that had been involved with the SAT test and all of that. And we've tuned that to our new college grad intern program so far. we've essentially i believe in a very fair meritocracy kind of way taken the whatever it is 10 50 60 000 people run them all through what we've i think shown to be somewhat of a very fair non-weighted by any other social factor assessment and the people that come out of there we have an incredible confidence that they're problem solvers um they do a bunch of other things really well So we kind of have this building wave inside the company of three years ago, two years ago, one year ago, these 100, 200, 300, 400 people that hopefully were like mentoring some of the best future leaders in the industry. Yeah, super interesting because I have a number of friends who always talk about how you discover untapped sources of talent or how you find the best people in the world and are there ways to test for that or sort of screen for that? We've done a lot of testing on this, fairness testing, looking backwards on it. I'm very confident in where it's going to go for us. Super interesting. Yeah, it's like a very systems-oriented approach. The one thing we have found which is a little edgy might be the correlation between traditional universities and our own testing. And we hire a community. Sorry, what's edgy about that? Well, I think people typically think like I went to Stanford. That's where all the top talent is. We have found that not necessarily to be true. And we have found community college, you know, the small Midwestern engineering school, like because we're assessing our own way, we kind of we basically ignore the signal of where you went to university. I've heard that anecdotally from other CEOs now, particularly for certain cohorts, like the cohort that came during COVID. For a lot of the top universities is perceived as like a weaker cohort. And I don't know the reason or the interpretation behind it. But it's interesting to see this shift in terms of how people even think about where are some of the best talents. So it's interesting that you're kind of seeing this as well. So we get to have self-determination. We get to say, colleges, you do what you want, all of that. We're just going to do it in a fair way that we think is our way. and it's worked out. Can you give just, because it's so interesting, like any intuition for something you, some way you test for problem solving capability? I think we make public some of the tests that we use. And the cool thing is they're all built on roadblocks. They're all tested by lots of people. And they're arguably really interesting three-dimensional problems like programming a factory or like you're using some new geometric language to program a robot. You know, it's almost like turtle graphics. And you can play with that and see how people... We're going to try to get jobs. Yeah. I would be, I'm actually might be a little afraid to take the test myself, given how good some of our candidates are. You know, as a long-term predictor of the future, Is there something happening in AI that you believe or hold with conviction like five years out that you think not everybody believes yet? That I believe that not. I think typically it's the other way. More people believe more stuff than I believe. You think of yourself as a skeptic? Well, I think of myself as... He's building the holodeck, but he's a skeptic. I think I'm more like the power of time and the power of compounding rather than like an amazing invention and just rapid iteration. One thing I constantly am amazed by is either the graphical user interface or Microsoft Excel. I think I was playing with Microsoft Excel in like the 80s. And here we are 40 years later. It's not that different. So it's kind of like this interesting compliment. In AI world, things are changing every day. We have to incorporate and do that. And then there's also some weird universal truths of things that stick around for 40 years and you kind of have to blend them together. So I think that's how we I think the good news is we feel if we build Roblox right, it might be the kind of thing that's kicking around in 40 years. Awesome. Thanks so much, Dave. Thank you for joining us. Thank you. OK, cool. That was really good. Yeah. Good questions. Find us on Twitter at NoPriorsPod. subscribe to our youtube channel if you want to see our faces follow the show on apple podcasts spotify or wherever you listen that way you get a new episode every week and sign up for emails