Science Friday

Secrets Of Ancient Concrete, And... Data Centers In Space?

18 min
Jan 14, 20263 months ago
Listen to Episode
Summary

This episode explores two distinct scientific breakthroughs: the discovery of an ancient Roman cement mixing site in Pompeii that reveals self-healing concrete formulas still superior to modern versions, and an examination of the feasibility and challenges of building data centers in space to harness continuous solar power for AI computing.

Insights
  • Ancient Romans used a 'hot mixing' technique (dry premixing of volcanic ash and quicklime before adding water) that created self-healing concrete superior to modern formulas, suggesting significant efficiency gains possible by studying historical engineering
  • Space-based data centers face fundamental physics and logistics challenges (cooling via radiation, kilometers of solar panels, massive launch costs, data transmission bottlenecks) that may not be solved by near-term technological improvements
  • AI model training's massive energy consumption is partly driven by pursuing general-purpose models rather than specialized domain-specific models, indicating efficiency gains possible through architectural choices rather than infrastructure relocation
  • The economics of space infrastructure depend heavily on external factors (battery capacity, solar deployment, small modular reactors) that will likely evolve significantly within 10-15 years, making current space data center proposals premature
  • Near-term orbital computing opportunities exist in edge processing (satellites processing their own data) rather than replacing terrestrial data centers, suggesting a gradual rather than revolutionary transition
Trends
Biomimicry and historical engineering analysis driving modern material science innovationSelf-healing concrete commercialization emerging from academic research into Roman construction methodsTech industry exploring radical infrastructure solutions (space, nuclear) to solve AI power consumption crisisGrowing recognition that AI efficiency gains possible through model specialization rather than scalePrivate space launch cost reduction enabling new infrastructure possibilities in orbitEdge computing in space (satellite data processing) as more viable near-term alternative to centralized orbital data centersEnergy landscape uncertainty (battery, solar, SMR deployment) making long-term infrastructure decisions difficultRadiative cooling and thermal management emerging as critical design constraints for space computingData movement bottlenecks limiting feasibility of cloud-scale computing in orbitShift toward domain-specific AI models as efficiency strategy versus general-purpose model scaling
Topics
Ancient Roman concrete and self-healing materialsVolcanic ash and quicklime cement formulationHot mixing concrete production techniquesModern concrete efficiency improvementsSpace-based data centers and orbital computingSolar power generation in spaceData center power consumption and grid capacityAI model training energy costsRadiative cooling in space environmentsSpace debris and orbital infrastructure reliabilityData transmission bandwidth limitationsEdge computing and satellite data processingDomain-specific versus general-purpose AI modelsNuclear power for data centersLaunch costs and space infrastructure economics
Companies
Google
CEO Sundar Pichai mentioned as tech leader considering space-based data centers for AI infrastructure
Amazon
Former CEO Jeff Bezos cited as tech leader exploring space data center possibilities
OpenAI
CEO Sam Altman mentioned as tech leader interested in space-based computing infrastructure
SpaceX
Referenced for significantly reducing launch costs, enabling new orbital infrastructure possibilities
Starlink
Communication satellite constellation cited as example of orbital infrastructure reducing launch costs
People
Ira Flato
Podcast host conducting interviews on concrete science and space data center feasibility
Admir Moshic
Researcher who discovered ancient Roman cement mixing site in Pompeii and studies self-healing concrete
Benjamin Lee
Expert on microprocessor design and data center efficiency analyzing feasibility of orbital data centers
Vitruvius
Historical figure whose documented recipes for Roman concrete mixing are analyzed in the episode
Pliny the Elder
Historical figure who documented recipes for Roman concrete with volcanic ash and lime
Sundar Pichai
Tech leader mentioned as considering space-based data centers for AI power requirements
Jeff Bezos
Tech leader cited as exploring space data center infrastructure possibilities
Sam Altman
Tech leader mentioned as interested in space-based computing infrastructure for AI
Quotes
"this substance when mixed with lime and rabble not only lends strength to buildings, but even when piers of it are constructed in the sea, they set hard underwater"
Vitruvius (quoted by Dr. Admir Moshic)Early in episode
"for me, that pile of dirt was years of waiting to really confirm quite a challenging hypothesis"
Dr. Admir MoshicMid-episode
"we have solar power there 24-7"
Tech leader (quoted by host)Space data centers segment
"the devil is in the details, right? What resources and money would it take to move these enormous structures into space?"
Ira FlatoSpace data centers segment
"if we wanted to send a large amount of data quickly, maybe from the east coast to the west coast, the easiest thing to do, the fastest thing to do would be to put a disk in the mail"
Dr. Benjamin LeeLate in episode
Full Transcript
Hi, I'm Ira Flato and you're listening to Science Friday. If you've listened to the show for a while, you know that one of my favorite topics is concrete, really. And some of my favorite examples of the long-term durability of concrete are from the Romans. Take the Pantheon and all those famous aqueducts built thousands of years ago and still standing. But how exactly was this concrete made? And what ingredients went into the cement? That knowledge hasn't been very solid. Well, late last year, scientists discovered an actual cement mixing site in Pompeii, preserved in the volcanic ash, and it might hold clues to how we can improve our concrete today. Here to uncover those secrets is Dr. Admir Moshic, Associate Professor of Civil and Environmental Engineering at MIT, and one of the co-authors on that study. Dr. Moshic, welcome to Science Friday. Thank you for having me. Nice to have you. So you go to Pompeii and you make a discovery there that changes about how they made their concrete? Yeah, so the context of Pompeii is fascinating. If you think about a city that 2000 years ago was literally frozen in time by this eruption of Montvezous, and then stayed preserved till we excavated it, offers an incredible snapshot of what they were up to. And interestingly, a year ago, archaeologists excavated and the construction site, including the very well-organized construction materials like roof tiles or bricks and the tools. So imagine literally an active construction site that allowed us to walk through and understand from the raw materials how they were mixed and prepared to be then used in construction. So imagine that people were building a house at the moment of eruption and literally stopped the operations and froze that scene. Then it felt literally like entering into Pompeii 2000. So it was for me a time travel, literally. From what I understand, the Romans left all of this concrete behind, but did they leave behind the recipe for making this cement that becomes concrete? Yeah, that's a great question. It's interesting that in that ancient time there were these scholars, architects and scientists that did document a lot of what they were up to. Some of notable ones are, of course, Vitruvius and Pliny the Elder, and both of them describe recipes for making this magic material. Vitruvius in his Thearchitectura talks about magic powder. He says, quote, this substance when mixed with lime and rabble not only lends strength to buildings, but even when piers of it are constructed in the sea, they set hard underwater. So they document this recipe of mixing volcanic ash, lime, and then they notice this fantastic property that it hardens underwater. Now did you discover that the ways that they made their concrete was different than the ways we make ours? So what these ancient scholars suggest is that lime, not the lime that we use in our cocktails, but processed limestone. So you take the stone, you create a kiln, and the product of this is quick lime, calcium oxide. And what these ancient scholars suggested is that this quick lime would first be mixed with water to make the reaction and create slag lime and then added to the volcanic ash to make concrete. What we found in Pompeii is something slightly different. Ancient Pompeians would take this calcine stone, grind it, mix it dry with volcanic ash, and then add water. And that makes a slight difference, we call hot mixing, because of the reactions of quick lime with water within the mixed temperatures that can go up to 200 degrees in some hot spots. With true views, says first slag lime and then mix it nevertheless. In Pompeii, there is clear evidence that the raw materials were premixed dry and then water was added. In this specific case of the Roman villa in Pompeii. And why is it that these ancient Roman structures are still so able to stand up for thousands of years? What's different about the cement in them than the cement we use? Yeah, great. And we are talking about a self-healing concrete. Because of this way of hot mixing that when the microcrack is formed, basically are dissolving and recrystallizing in cracks that cannot be met with our modern analogs. That's amazing. I want to ask you what it was like standing in this workshop that's thousands of years old for the first time for you. Oh, personally for me, was outstanding in the sense that together with my team at MIT, we came up with this theory based on the research that was done on ancient Roman walls in little town in Priverno. Of course, analyzing past mortem concretes in the sense that they were already mixed. And all our crazy hypothesis that indeed Romans use hot mixing, many of my colleagues criticized these arguments simply because it's difficult to think that this process might have been applied by Romans. Because Vitruvius says, hey, do this. So for me, finding a pile of premixed dry volcanic ash and quick climb was incredible. I got emotional. And of course, my archaeologist friends made fun of me saying, Admir, I mean, there are beautiful frescoes around you and you get emotional and cry by looking at the pile of dirt. You see, for me, that pile of dirt was years of waiting to really confirm quite a challenging hypothesis. Well, as someone who loves to talk about concrete, I can see how you can get emotional about that also. Let me return to one question about that's fascinating about the self-healing quality of the concrete that they made. You say modern concrete does not have the self-healing quality. Is it possible to put that into modern concrete somehow? Yeah, that's exactly what we are up to now. And we were able to patent some of these ideas and the companies are starting to offer self-healing Roman-inspired concretes out there. That's great. Thank you, Dr. Masic, for taking time to be with us today. Thank you very much for having me. You're welcome, Dr. Admir Masic, Associate Professor of Civil and Environmental Engineering at MIT. After the break, we're going to move from something concrete to something still on the drawing boards. How realistic is it to move data centers to space? Stay with us. On the broad side, we take you into the heart of the South, with stories that'll surprise you. Bigfoot apparently loves glow sticks. Exactly, he's a raver. And topics that dig into the muddy margins of history. The good, the bad, the ugly. It's not clean at all. It's so messy. Wait a second, this is actually real. Listen to the broad side, one story every week, exploring the rich traditions of the South. As tech companies build up data centers for AI, they are also searching for new ways to supply the immense electrical power necessary to run them, like reviving old nuclear reactors, for instance. But lately, tech leaders like Google CEO Sundar Pichai, former Amazon CEO Jeff Bezos, and open AI CEO Sam Altman have been thinking not only outside the box, but out of this world. How do we one day have data centers in space so that we can better harness the energy from the sun? So these giant training clusters, those will be better built in space because we have solar power there 24-7. The world needs a lot more processing power. If that looks like tiling data centers on Earth, which I think is what it looks like in the short term, or we do go build them in space. I don't know, it sounds cool to try to build them in space. Yeah, it does sound cool. But you know what? The devil is in the details, right? What resources and money would it take to move these enormous structures into space? And does this mean we could start seeing more of our infrastructure move into orbit in the next few decades? Here to beam us up is Dr. Benjamin Lee, professor of electrical and systems engineering at the University of Pennsylvania in Philadelphia. He studies microprocessor design and how to make them more efficient in data centers. Welcome to Science Friday. Thank you so much. Wonderful to be here. Nice to have you. So, you know, in those clips, we just heard it sounds like that power is the main draw. Is it as simple as that? There's more energy available in space. So let's put stuff up there. That's certainly the starting point, as many of us already know, finding the energy on today's grids is increasingly difficult, especially given the size of our data centers. We're talking about a thousand megawatts, 2000 megawatts. And grid capacity is scarce. And certainly many of the hyperscaler data center operators are having difficulty finding sites that can support those power loads. The second issue really is about where the energy is coming from. There has been a lot of interest in carbon efficient energy. So solar is certainly one of those. But solar energy on Earth is clearly intermittent. You can't compute with solar energy in the middle of the night. And launching data centers into space could solve that problem. We could put data centers in sun synchronous orbit and get solar energy exposure on those solar panels pretty much continuously. So I think energy is definitely the starting point for orbital data centers. Well, let's look into those those devils in the detail. How big would the solar panels have to be to capture that much power? Right. So we're talking about kilometers of solar panels. If we're talking about these giga scale data centers, if you're talking about a gigawatt or two, those panels end up being fairly significant. And the size of it is one thing. But the launch costs, the weight of those panels and sending that all up to the space, it would be certainly another. Yeah. And when you have panels or anything in space that big, don't you have risks from, well, let's say the space debris for these massive structures? Certainly. And reliability and repair is an ongoing challenge for anything we send into space. We know that especially for these largest data centers, components will fail occasionally. And we will need a strategy to replace and address that. And that's true for the hardware components that perform the compute. But it's also going to be true for the solar panels and other infrastructure that goes up. Well, you know, on Earth, these data centers are cooled by water. How would you cool them up there where there is no water? That's right. And so the fact that space is cold is one thing, but it doesn't really help our ability to extract the heat from the processor chips and send it out into the ambient. Normally on Earth, what we do is we rely on blowing cold air or flowing cool water over the compute and then eventually releasing out into the atmosphere. Without an atmosphere in space, you would need to rely on radiative cooling and radiative cooling really relies on yet more panels and larger surface area that would allow us to radiate that heat out into space. So not only are we talking about the surface area for the solar panels, we're also talking about surface area for the cooling. OK, so let's say you've got these data centers in orbit around Earth and they're crunching a lot of data. How do you effectively communicate with them at high speed, sending the data back and forth? Right. We might be able to send on the order of 10 gigabits per second up into space using radio frequencies. But the difficulty is really about moving large volumes of data. So in one of the earlier clips you aired, there was a discussion of training large AI models in orbit. The difficulty is that training requires massive data sets, essentially all of the internet's data. And getting all of that data up into space would be challenging. We would essentially have to launch that data up into space along with the compute. That's an old joke in computer science where we say that if we wanted to send a large amount of data quickly, maybe from the east coast to the west coast, the easiest thing to do, the fastest thing to do would be to put a disk in the mail. And I think that's certainly true when we're talking about sending things into space as well. Well, you've mentioned all the negative parts about doing this, all the challenges of putting data centers in space. Why not just make data centers on Earth be more efficient in how we make power and how they process data? That's right. And I think right now we know that we are somewhat wasteful in how we are consuming data center resources. We are pursuing first and foremost better and better AI models. And we're willing to pay whatever energy cost it takes to get that new capability, that new application. We don't want to worry whether or not if we had just thrown an additional 100 megawatts at the problem, we could have gotten something we didn't have before. So right now when we think about the AI models, they are equipped to answer any possible query that any possible user could pose to it. And that generality really is computationally expensive. If, however, you knew that you wanted a model for finance or you wanted a model for medicine or for education, you could come up with specialized models that could give you an answer that is just as good, but require far fewer calculations. The reason why we haven't done this yet is because we don't know what those really compelling applications are, the ones that will change the way we live and work. But once we figure those out, I think there will be plenty of opportunity to reduce the energy costs and improve energy efficiency. Because what you're talking about, these guys are talking about going into space, that's not going to happen this year or 10 years from now, is it? And in that time, who knows what kinds of efficiencies we might have. That's right. And going back to your other point, I would also say it's very hard to know what the energy landscape in the United States will look like in 10 or 15 years, whether we will have much more battery capacity, much more solar capacity, small modular reactors. All of that is also possible within the next 10 or 15 years. And that may change how we view the relative merits of doing one of those things versus sending data centers into space. Do you still think, though, that we should be thinking about sending data centers into space as more than just a thought, as a possibility? I think replacing these massive terrestrial data centers with orbital data centers is really ambitious and potentially a long-term goal. But in the near term, I think there are really interesting fundamental research questions going back to some of the things we had just talked about, radiation hardening, thermal management, power delivery. I would also say that the challenges associated with data movement also means that there is an opportunity to do more computing space. Maybe we have satellites collecting massive amounts of data, image data, or other kinds of data from orbit. Instead of sending that all down to Earth for processing, you can imagine doing more of that computing space. I think that would be a really great application of orbital computing without going to this end goal of replacing massive terrestrial data centers. So you do think we should expect to see more of our infrastructure moved into orbit? Yes, and I think that that is a natural progression from where we are today, where we are seeing with SpaceX and other private space companies significantly reducing the cost of launches and also with the advent of these constellations of communication satellites like Starlink. I think putting some amount of compute to complement that communication would be really exciting and would make a lot of sense, but maybe not at the scale of a thousand megawatts of data center capacity. Thank you Dr. Lee. Terrific. Thank you so much. Really enjoyed it. Dr. Benjamin Lee, Professor of Electrical and Systems Engineering at the University of Pennsylvania in Philadelphia. This episode was produced by D. Peter Schmidt. I'm Ira Fletto. Thanks for listening.