Galaxy Brain

Chris Hayes on Calibrating Your AI Anxiety

47 min
May 15, 202616 days ago
Listen to Episode
Summary

Chris Hayes and Charlie Warzel discuss how to calibrate anxiety about AI by examining it as a normal transformative technology rather than an existential threat. They explore the 'jagged frontier' concept—how AI excels at some tasks while failing at others—and debate whether AI represents genuine progress or an irrational bubble, using historical parallels like railroad overinvestment to contextualize current hype.

Insights
  • AI discourse is dominated by tail outcomes and mythic narratives (Frankenstein, Terminator) rather than realistic bell-curve expectations, creating disproportionate anxiety among the general public
  • The technology's concentrated capital requirements and power structure differ fundamentally from the distributed internet, raising questions about who benefits and who bears the costs of AI deployment
  • Distinguishing between generative/creative AI use and grunt work automation is critical—outsourcing thinking atrophies cognitive skills while automating drudgery can enhance productivity for knowledge workers
  • AI's impact on electoral politics and information control represents an underexplored frontier risk, particularly regarding model bias and who controls the algorithms shaping political discourse
  • Both irrational exuberance and complete skepticism are problematic; productive policy requires mediating institutions (like the FDA/Fed model) rather than either unfettered deployment or blanket prohibition
Trends
Grassroots backlash against data centers and AI infrastructure is emerging as a bipartisan political issue, with 46% of voters viewing AI negatively vs. 26% positivelyThe 'jagged frontier' is creating winner-take-all dynamics where some professions (coding) see massive productivity gains while others (creative work) face displacement without compensationAI is becoming a litmus test for tech regulation philosophy, with both left and right questioning whether current regulatory frameworks (FTC, FCC) can govern concentrated AI powerEmbodied cognition and sensory experience are being recognized as fundamental limits to AI reasoning that current models cannot overcome, reshaping consciousness and AI capability debatesEconomic displacement from AI automation may occur faster than policy responses can address, creating a window where concentrated wealth gains outpace distributed benefit distributionThe speed of AI capability improvements is outpacing public discourse and policy formation, creating an exclusionary 'hothouse' community on platforms like X that alienates mainstream audiencesAttention economy dynamics are amplifying AI discourse extremism; the crazier the claims, the more engagement, creating perverse incentives for hyperbolic narratives over nuanced analysisHistorical technology adoption patterns (railroads, electricity, internet) show transformative technologies can simultaneously be subjects of irrational bubbles and genuine progress
Companies
OpenAI
Discussed as major AI company with significant capital investment and influence over AI narrative and deployment
Anthropic
Referenced in context of consciousness research and corporate utility of AI systems
Google
Mentioned as information portal being replaced by AI models as primary search/discovery mechanism
X (formerly Twitter)
Identified as primary platform where intense AI discourse occurs, creating exclusionary hothouse community
Meta
Referenced as company building AI while opposing content moderation regulation
Tesla
Associated with Elon Musk's AI ventures and Grok model development
Microsoft
Mentioned in context of Copilot tool and enterprise AI adoption
People
Chris Hayes
Guest discussing his new AI podcast series and framework for calibrating AI anxiety with anthropological perspective
Charlie Warzel
Host of Galaxy Brain podcast conducting interview about AI discourse and regulation
Alison Gopnik
Featured in Hayes' podcast discussing human intelligence vs. large language models and embodied cognition
Elon Musk
Discussed as influential AI figure with potential bias in Grok model affecting political discourse
Sam Altman
Referenced as billionaire AI leader making claims about job displacement and economic disruption
Dario Amodei
Quoted discussing concentrated nature of AI industry and cloud computing economics
Yann LeCun
Referenced for insights on embodied cognition and sensory data limitations in AI systems
Anil Dash
Cited for observation that programmers embrace AI for drudgery while maintaining creative control
Ethan Mollick
Credited with coining 'jagged frontier' phrase describing uneven AI capability distribution
Bernie Sanders
Mentioned as political figure calling for national data center moratorium on AI infrastructure
Ben Collins
Former colleague referenced for discussing political jump ball nature of AI regulation
Ron DeSantis
Mentioned as political figure with populist rhetoric on AI regulation
Quotes
"The jagged frontier is meant to describe how AI can be extremely and unexpectedly good at some human tasks, and then also extremely and unexpectedly bad at others."
Charlie Warzel
"If you're having it do your brainstorming like your brainstorming muscles are going to get weaker. And I don't want my brain. That's my livelihood. My career is coming up with stuff. I got to keep that sharp."
Chris Hayes
"There is an inherent sort of pro bias to the technology and that it basically becomes a tool for accelerating the concentration of wealth and power in smaller and smaller hands."
Chris Hayes
"The railroad was both transformative and also an insane gold rush of overinvestment and too much capital that ended up going bust multiple times, producing some of the worst cataclysms including a Great Depression in 1893."
Chris Hayes
"Imagine the power of being able to control what that information was about who's running for office and what they stand for and who you should vote for. That to me is a frontier that we haven't breached yet."
Charlie Warzel
Full Transcript
I'm Carla Lolly, cookbook author and snack enthusiast. Do you have a sweet tooth? Check out Sweets Unwrapped, a podcast from Ferrero and the Atlantic's Creative Marketing Studio. Together, we're celebrating the traditions that make life sweet. Tune in now. If you're having it do your brainstorming like your brainstorming muscles are going to get weaker. And I don't want my brain. That's my livelihood. My career is coming up with stuff. I got to keep that. I got to keep that sharp. Now, maybe in five years, they'll just have an AI do my show. And the AI will generate all the takes, and the AI will talk, and I'll be out of a job. Right. Fine. But until that happens, I don't want the AI doing that. I'm Charlie Warzel, and this is Galaxy Brain, a show where today we're going to calibrate our feelings about artificial intelligence. There's this phrase that's coined by AI researchers that I can't get out of my head these days. It's called the jagged frontier. The phrase is meant to describe how AI can be extremely and unexpectedly good at some human tasks, and then also extremely and unexpectedly bad at others. Individually, this can mean that it's useful or even transformative for some people, while others see it as unnecessary or even more akin to snake oil. For example, large language models, and especially coding agents, have transformed the job of many programmers, making them more productive. That's not true of all industries, though, especially creative ones, where there are moral or financial or creative reasons to object to its use. The jagged frontier is meant to apply to use cases in industries. In some ways, it's an echo of the old cliche, the future is here, but it's not evenly distributed. But lately, I've been thinking about the jagged frontier as it applies to the broader AI moment and the discourse. This moment that we are living in, the AI boom, the hype cycle, or revolution, you choose your own language. It's a weird one. If you try to keep up with industry news, it's easy to feel just instantly overwhelmed. There's the obvious existential stuff. Will AI replace all white-collar workers? Is AI making us dumber or lazier? There's also a lot of what's being described as AI malaise. It's this ambient feeling that there's too much happening too fast and without most people's say. On places like X, there's all kinds of breathless chatter about people setting up swarms of bots to run their computers and monitor their personal lives. or of people creating vibe trading platforms that can make and lose money while they sleep. CEOs aren't just talking about job loss. They're writing 14,000-word essays about a future where, quote, our current economic setup will no longer make sense. Now, if you're a regular person, the type of person who's more worried about the price of gas right now, these conversations can sound like they're coming from another planet. And they're also making a lot of people ambiently anxious. If you're at all skeptical of the AI industry and the men who lead it, then you'd be right to be concerned about the future that these companies are outlining. So how do we calibrate our anxiety and our expectations about AI in this moment? How is AI going to impact our politics in the coming years? Should you be scared, excited, angry, sad, some unholy mix of all of that? Chris Hayes has been asking these kinds of questions for the last few months. Hayes is the host of All In on MS Now and the host of the podcast Why Is This Happening? He's also written a great book on the attention economy called The Siren's Call. Chris has this new podcast series out about the AI endgame, and in it he does something that I think is really crucial. He tries to make sense of this moment with an almost anthropological perspective. So many people in the AI discourse are just in so deep that it can be really, really hard to see the big picture. And so I brought on Chris to do just that. Chris, welcome to Galaxy Brain. It's great to be here, man. Thanks for having me. So you've described your feelings about AI in the first episode of this short-run podcast series that you're doing about it. The whole generative AI revolution, the discourse, the whole thing as having, I thought this was great, like a bodily somatic effect on you. Yes. So tell me about this feeling. I want you to describe it. What happens when you encounter the news or discourse about AI? There's this feeling that I've come to describe or think of as the bad feeling, like capital T, capital B, capital F, which is just a feeling of kind of like anxiety, doom, shutdown that I get, you know, from a lot of things. Some certain political news will give me the bad feeling. And basically the AI discourse gives me the bad feeling usually because it feels like the end of something. It feels like it's going to destroy things I love or maybe lead to the end of human civilization. It, you know, some, some version, some high-tech version of nuclear winter that we can only sort of hardly imagine. And I think it puts, because of that, it puts me in this kind of fetal position, defensive crouch. And I think also it's the case. One of the goals here is there's a world of people who are very in the AI discourse. And that world is very fertile and intense. And it's largely happening on X still. But it's also like its own kind of bubble. Totally. And with, you know, and I think people outside of it find it scary and alienating. And I think that's actually like a huge amount of people, most people at this point. Yes. And so part of what I'm trying to do is like penetrate that from the outside, because I'm not I had not really been in that discourse intensely to try to penetrate it in a way that I can be a kind of guide for other people that are outside of it, if that makes sense. It does. I have this theory, essentially, that we all have AI psychosis, right? Like we've been using that term to describe this problematic relationship that some people have with chatbots. It's an informal, non-medical term. But like, broadly speaking, AI driving folks, you know, informally insane. It's like your boss has AI psychosis and they will only accept marketing summaries that go through Copilot, right? Like programmers have it because they're getting this competency high of like 10xing their productivity. And I feel like you have these people on X who definitely are marinating in this like micro discourse that's very similar to the way that like Twitter weird in politics, right? Absolutely. And then the skeptics, I think, also have a version of it because you either have skeptics who are like, I'm putting my fingers in my ears. I'm waiting for this to pass. Or you have people who are like, I believe that this is very dangerous. I'm curious, like, why do you think we can't have a regular conversation about AI? It's a great question. I mean, I think probably all discourses around transformative technologies tend to be a little berserk. So I think that's part of it. I think we have an attention economy that is particularly inclined towards like psychosis because the crazier things are, the more attentionally salient they are, the bolder the claims, the more attentionally salient. It also moves so fast, like the speed of it, which I saw someone the other day saying like, we don't talk about Cloud Code anymore because we talk about Codex. Like Cloud Code was last week's thing. It is no longer like relevant to this thing. And I'm like, if you are moving in like the broad, everyone needs to be paying attention to our conversation. If you are moving at the speed of if you weren't paying attention on a daily, weekly basis, like you don't belong in this conversation anymore. It almost feels to me like it's supposed to be a little bit exclusionary in that way. That's fine, too. I mean, you know, specialist discourse is a thing that you find in all sorts of domains and realms. And, you know, I don't even begrudge that. One of the things I'm trying to do is just open up to people that aren't inside the conversation. And not, again, I'm trying to do it that's not in the hothouse. Like, very intentionally. Yeah. Of, like, at the sort of coming from, almost, like, intentionally coming to it from the outside. it because I think people who are making AI and doing AI are all doing each other's podcasts like constantly. It's just this entire discursive engine that's just churning out, you know, code and content and models. I'm trying to find a way in as a kind of Virgil figure guide for people that are outside of that because it is alienating. I got to say, like, you know, it really is. It has a very cultish hothouse, you know, true believer feel in there. Well, and in the same way, too, like I can see it radicalizing people. And again, that's why I think like the politics thing is so salient. OK, so I love this idea. You're coming from it from the outside. And since you've been doing this and you've had this experience, I would love if you could kind of give me the optimist take and the skeptic take as as you see it. One concept I've been playing with is let's think about a normal distribution of outcomes, a probability curve, a bell curve. I think a lot of the discourse ends up focusing on like tail outcomes as opposed to like the center of the bell curve. And I think partly that's because that center has moved so quickly that people are, you know, pulled towards the tails. And I think partly that's because of we're inheritors of an entire mythic superstructure that, again, I think the like the AI people think is like nonsense, you know, liberal arts major craziness, but is clearly structuring the way everyone thinks about this. like the myth of Gollum and Frankenstein are obviously massively influential in the narrative structure people are imposing on this. And the Terminator. Yes. Like, yes. Yes. And how like everyone like, again, there's a reason that like our technologies ape science fiction. And it's not because science fiction was so prescient. It's because it's literally the thing that was consumed by the folks that are making the technology. Totally. That's why it happens. It's not like, wow, how did they predict that? It's like, no, there was no future. We got those messages about what technology should look like, everyone grew up with it, and then they made the thing, right? So I keep coming back to this idea of like, let's think about it as a normal technology. Right. Like, what does it mean for it to be a normal technology? And what that means is like, okay, automobile, personal computer, the internet, cell phones, radio, television, the telegram, electrification. These are all normal technologies, massively revolutionary, enormous consequences, like huge, huge costs and huge, huge benefits. But fundamentally, human life went on. Like it didn't it wasn't the end of us. So in some ways, I think that's kind of the optimistic take, right, is that it's a normal a normal technology with dislocations, costs and benefits that we can reason together around and try to find ways to distribute the benefits broadly and mitigate the costs. The pessimistic take I have is that similar to the way that, say, industrialization functioned, which required a sort of creation of wage labor and a concentration of capital, right, and a kind of extractive relationship from the beginning, that there is an inherent sort of pro bias to the technology and that it basically becomes a tool for accelerating the concentration of wealth and power in smaller and smaller hands And I think there's a lot of reasons to think that's the case, unfortunately. I love pairing the normal version of this also with it being almost in some ways less revolutionary than put forward. The thing that sticks in my head as the keeps me up at night part of this is not like, you know, the the paperclip maximizer, we're all going to die human extinction theory. And it's so much more like, look at the money that is being invested into this thing, sort of an unfathomable, unprecedentedly quick amount of spend into the infrastructure and backing of this technology. All those people expect a return on an investment at a level sort of never before seen, which would then mean it works really well, which would then mean like probably a lot of economic displacement in a way that like we have no way of dealing with in a in the short term and it's like that's the thing that scares me there's two options right i mean a lot of people put it this way this is not a unique insight of mine at all right but like there's the success which is all of that investment is rational and is producing a technology that is paying for itself with productivity gains in which case if that's the case um it's a dislocation unlike anything we've seen. Or it's irrational and there's an enormous bubble that goes bust. And that has enormous financial consequences that leak out into the real economy and end up hurting a lot of people who had nothing to do with AI, right? Both of the, it's probably one of the two. And I think the railroad example, everyone keeps coming back to it, but I do think it's useful. Like I didn't know this until I was going back in it, that like the railroad was both transformative and also an insane gold rush of overinvestment and too much capital that ended up going bust multiple times in the last few decades of the 19th century, producing some of the worst cataclysms, including like a Great Depression in 1893, that the US economy had ever gone through. I mean, we didn't remember, we didn't have a central bank. Thank you, Andrew Jackson. So, you know, there was no, and there was no FDR figure. It was just like, whoopsies, now we've got a Great Depression, everyone's out on the street, and your family might be starving because we devoted too much capital to the railroads. Which is, you know, again, what I think is useful about that example is that doesn't mean the railroad was bullshit. Right. Like, it turns out the railroad actually was a pretty transformative technology. It can be the case that a transformer technology is also the subject of an irrational bubble and overinvestment. I also think to like add another layer of confusion to all this is the fact that like the markets are behaving supremely irrationally right now. Narrative may be more important than actual reality. The other thing I would say about the way the markets are acting, I mean, there's a bunch, there's a lot to say about that. I think there's really, really incredibly smart, sophisticated people who are, you know, making bets that are totally defensible bets. Okay. But a, it's been 18 years since people got wiped out. And there's a whole group of people who are working in this world who never came into the office to watch everything go boom. And let me tell you, that changes people. Like it just does. Uh, it, you know, again, these are all human beings doing this. There's a human beings who are the subject of culture and group thinking. And, and I know this personally from people like coming into work every day and watching your portfolio just absolutely get annihilated day after day while everyone's getting annihilated is an experience that is a generational experience that a lot of the people haven't haven't had in a long time. Yeah, we can't keep anything in our heads for more than like, like, four seconds. We're not even talking about the assassination attempt on the president that happened like two weeks ago. When you just said that phrase, I was like, what? When did that happen? Huh? So I think I think that's part of it. But I also think the other thing I would say is there really is a lot of radical uncertainty, you know? So everyone's kind of, you know, making these bets about a future that is really is quite unclear. Since we came out of the caves, people want to know the future and you can't know the future. That's the fundamental human condition. Look at the Godin Trails. You can consult the Oracle Delphi. You could look at Polymark and Kelshi. You can subscribe to Nate Silver Substack. None of it will get you the thing you want, which is knowing the future. And everyone is making bets on the future, but the future is unknown. But first, a quick break. founders. Join me, Grant Hill, and others for a deep look at what it means to be a thought leader today. Watch the films at theatlantic.com slash drive to lead. Part of what I hear you grasping for in these pods and part of what I think we're all grasping for, again, it's not just the unknown part of the future, but it's also trying to calibrate for how powerful is this technology, right? And you had an episode with Alison Gopnik, the cognitive psychologist, philosopher that I I thought it's really illuminating because it's exploring human intelligence and the ways that large language models are really working very differently than, say, like, you know, human's mind. And so you're hanging out with someone at a bar. They're asking you, like, are these models, you know, alive? Are they reasoning or whatever? How do you think about human intelligence versus what's being marketed as artificial intelligence? And how are you talking to people about that? That's a great question. I guess my feeling about it is it's built extremely differently than human intelligence, largely because of the sort of experiential stuff that Allison talks about, the way a child learns. But it may turn out at a sufficient level of computation and sophistication, like enough power and enough weights and enough complexity, things converge on each other is kind of the way I think about it. Like, and one of the things I found useful is we just do a lot of patterned behavior ourselves. And I think if you take a step back to think about that, it's actually really illuminating that a big part of what we're doing is stimulus response off of pattern triggers. And that doesn't mean we're not conscious and it doesn't mean that we don't have free will. And there's a bunch of interesting philosophical questions. But like, I always start with people when I, when literally they're like, what is this saying. I'm like, you know how you write someone invites you to a party and say like, I'd love to, but I can't. And the last two words are make it like, we all know that. Why do we all know that? Well, that's just a pattern response. It's like, well, you can train a computer to figure that pattern out using a bunch of weights of words. And then you start building out from there. You start getting like, there's a fair amount of human behavior, right? That's It's working off of that kind of computation. Totally. People are always trying to, if not impress, actually impress. It's trying to relate to somebody in a way that makes sense, right? Which is taking all the cues, all the things you've known, trying to make yourself intelligible to another person is in some ways your brain saying, what comes next? What is the most normal, rational, smart, funny, provocative next phrase, right, based off of everything that I know. And so I do like that a lot. What I found comforting is this idea that, yes, we can throw as much compute and as many weights and as much pre-trained data, and it gets a little bit better or maybe a lot a bit better, right? It starts to do something emergent that feels powerful. And yet, at the same time, The fundamental human thing is like the being a sack of meat walking through the world, getting sunburned, you know, seeing a baby cry, doing whatever. Right. And that feeling like there is nothing in the pre-training or the training or the whatever that can actually get to like the physical you have senses. Totally. Feeling that makes that impacts reasoning more than I think a lot of people are talking about or thinking. Yes. And I think it's Jan Lecun has this big point about this, right? Like, unless it's got human vision and human touch and human smell and like you're like just even at a at a kind of empirical level, the amount of data you're having it is nothing compared to the amount of data that a human gets through their senses. Right. Right. You could read the whole Internet. It doesn't touch like a year in the life of a two year old. Right. Right. Um, so, but what I think is interesting about that, there's two, to me, that's interestingly a double-edged sword. And this comes out in the conversations I have with Michael Paul and David Chalmers about consciousness, which is like, this has made me more humanist in some ways, this whole, this moment. Um, but it's also like, if we keep pushing on that, right, if the, if the big difference is that it doesn't, it's not the embodied meat sack that we are, and it doesn't have the senses, like, it's also not clear to me. that's a theoretical limit as opposed to just a limit right now. Say more about that. Well, I don't know. If you build the robot that's got like vision and some version of hearing and it's got some sort of olfactory sense and you build sensors and you give it a model five years from now and unleash it on the world, like things that I thought would only be us have fallen in very quick order, which is, which is both scary, but also I think creates a little humility about what is that thing? You know, I mean, you already see it in the way people move the goalposts on AI, particularly when they're skeptical of it. Like, well, it can't do this. And then it does it. Well, it can't do this. It's like, well, it can't love. It's like, okay, well, it can't love, but it just went through my entire inbox and told me like, I should respond to these three emails. and it was right about that. And six months ago, it couldn't have done that. So like, I don't know if it's going to be able to love in six months. Well, one thing that I think about with this as a positive offshoot that sort of, you know, bridges the two gaps in that. What I love about the consciousness research and the research of all that is not like, oh, is the AI conscious? Like, let's prove it. Let's, you know, let's give Anthropic another thing to stand on or something. I don't really care about its corporate utility. What is awesome to me is when scientists are like, we're starting to ask different questions than we wanted to ask in 2019 because of the way that we don't understand how these things are doing this. We also don't know how this thing is doing it. So now we get to do a different course of study. And I think to the extent that this revolution could impact other areas of like let figure out how this stuff works We actually know nothing about consciousness You know that to me is like really inspiring and interesting and cool And I agree. And I think actually the place that this, that's, that's at the expert level, but to me at the folk level, at the level of just ordinary people, it's like, and one of the reasons I did the podcast is, you know, my background as an undergraduate in philosophy, I've always loved philosophy. Like it prompts a question of like, what it is, what makes us human? What, what is, what is special about us? What, what is distinct about being human? Why is that important? What, and, and I actually think we're at a moment in our politics where, you know, it's, it is so much trench warfare and, and it is such an intense national emergency and an emergency. I feel very deeply, obviously, and spend most of my waking moments devoted to trying to, uh, figure out these sort of grounding foundational values. Like I, I, it's scary to think about a challenge from a machine to my own personhood, but it also is doing something useful and important, which is all of us to think about what do we have in common? What does make us human? What do we care about? Where do our values come from? And why should you treat people with kindness? Again, this is the glory and the difficulty of philosophy is ask very, very basic and simple questions that have incredibly elusive and difficult answers. And we don't have a lot of opportunity and our normal navigation of the world and the news cycle to have those. But if anything prompts it, it's this. Yeah, I feel that so much. And I also feel the opposite part of that, which is like, I don't really want like Elon Musk and Sam Altman being the people who are like forcing me to answer these questions or like Mark Zuckerberg, what I'm still grappling with in my day job. And I think we're all societally grappling with all of the stuff that they built and like the mess that has been left in the wake. And it's like, okay, no, no, we're going to like, it's almost there's like a toddler element to it where it's just like, we're moving to the other room and we're going to make more Legos and it's going to be another mess. You're like, but you got to put away the mess. I mean, the Tom and Daisy line from The Great Gatsby, which is now one of those kind of cliches, you know, like the party told you to disbelieve the evidence of your eyes, that just everywhere on the internet, but they, you know, they were careless people and they broke things and left other people to clean up the mess. I mean, it's just so true. I mean, I saw, you know, I saw a clip of the all in dudes who are, you know, they're talking about, you know, our word maxing very like self-satisfied with their like transgressiveness and like just do stuff and try. It's like, yeah, well, you know, things have worked out for you, you know, but the person that like used to handle baggage for Spirit Airlines, like the just do stuff, like let's start a war that we're on didn't work out for that person. Right. Nor did it work out for the families of the children that were killed on the first day. So certain people in certain positions can just try stuff and have a boundless risk appetite and never experience the downsides. And what happens is the other people experience the downsides. And this has been true forever. If you read the history of the wars of Europe, like who's starting the wars and who's dying in the wars? You know, that's that sort of ever has it been thus. But it really feels that way right now in a way that I find kind of intolerable, actually, and pretty, pretty radicalizing. I want to talk just about the actual what it's doing to us right now. Also in relation to, you know, you wrote this wonderful book on attention and the attention economy. One of the salient parts in it is even just talking about our own capacity for boredom, the ways that, you know, all of the Internet, all these tools are playing with our mind. How that's that idea of boredom that's sitting with your thoughts has been eradicated for most kids, most adults even. And as I was thinking about this and how to frame it to you, I came across a Wired piece that came out about this survey from Carnegie Mellon, MIT, Oxford, UCLA. Top line takeaway, it's really good for a headline, is using AI chatbots for even just 10 minutes may have a shockingly negative impact on your ability to think and problem solve. I saw this. I'm wondering how you are thinking about this also coming off of the social media, you know, this the deepening and fracturing of our attention, our ability to to attend to other things and ourselves and then it being turbocharged by AI on this scale in ways that we can't even grasp. Like, what is what's the sirens call analysis of this of just like AI use right now? My first cut at the answer is that, like, it's obviously going to make people dumber. Like, I mean, I just think it's clearly, and here's, I think, a distinction that I have made in my own AI usage. And I think it's an analog to a distinction I talk about in Siren's Call about how people use technology. I put texting with your friends in a totally different category than scrolling vertical video. Like texting with your friends is a thing that you're using the medium to do something that's like a human thing. I used to talk to my friends on the phone every night. Vertical video is doing some other thing algorithmically to your attention sensors. And yes, it's both the screen, but to me, they're actually quite distinct. And I feel this way strongly about AI in this respect. People do a lot of really like the idea of AI doing the thinking, brainstorm ideas, generate. I never use it for that. I don't want it doing that. I use it a lot to be like, can you help me find this stuff? Can you go through my emails? Like this distinction to me between like generative and creative thinking and like basically what I would call grunt work. I really think there's a distinction to that. And I think one of the weird things also about the way AI got marketed from the beginning was like, we're going to do all the thinking now. We're going to do all the generation. We're going to make the paintings and make the music. And like, and what, and then it's like, well, what am I going to do? Right. I want to do that stuff. I want to come up with the title for my show. I don't want AI to come up. I want to do that. I do want AI to like tell me which emails I miss that I need to reply to. One of the things they talk about in that paper, which I was reading earlier today, is like brainstorming. And I just think, man, that is a dangerous, dangerous road to go down. Because if you're having it do your brainstorming, like you're brainstorming the muscles are going to get weaker. And I don't want my brain. And that's my livelihood. My career is coming up with stuff. I got to keep that. I got to keep that sharp. Now, maybe in five years, they'll just have an AI do my show. And the AI will generate all the takes. And the AI will talk. And I'll be out of a job. Right. Fine. But until that happens, I don't want the AI doing that. What's so frustrating is there's always this, I mean, first you have the, you have the reality that the news thing that's supposed to make you more productive is just going to free up time for more work, right? Email kills the memo. No, it doesn't. Slack kills emails. No, it doesn't, you know, whatever. Like all these work productivity tools, they just, I think it's called Parkinson's law is, is it just, it fills the time. Anyway, you had this conversation in, in the first episode of the podcast where you're talking about writing and you pause it, like, Maybe writing is similar to being handy, right? When everything was analog and you had to know how to fix your sink, your lawnmower, your car, whatever, a lot of people had those skills. Things became less analog, harder to fix. It was easier to get things fixed. Fewer people are handy in that way that, you know, my grandfather was handy. Maybe that's like writing and that technology. And it's like absolutely terrifying because writing, like it's not just a skill. And I don't say this just because I'm a writer. It's the same as brainstorming. The creative act, whatever it is, those constraints of the mind and thinking and creativity are just how you do everything else. Like it's the building block for whatever. It doesn't have to be writing. Yes. And I just think like if you get rid of that, like that's the paperclip maximizer to me. That's the society that's like, okay, we don't have anything to do here anymore. Like we're, we're doing Wally now, you know? Yes. I mean, I, I feel the same way. And I think this sort of question of like, are humans even necessary at a certain point is, is, is the question you end up sort of barreling towards, um, you know, in a world of AI increased automation and declining birth rates. It's like, what, what, what do you need us around for anymore? I got a lot of feedback to that. Cause I think it's, it's sort of a useful one. The reason that I said it to myself was, you know, in the context of that conversation with Derek is like, I'm a writer. Like I have encountered handy people in my life who have remarked as I mentioned something that I'd hired someone to do, be like a little, like, why'd you do that? You can do that. You can figure that out. And it's like, yeah, I probably could, but you know, life's short and I've devoted myself to a bunch of other skills and maybe I'm just precious about writing because that's what I do. But I totally agree that it's in, you know, writing is thinking, brainstorming is thinking. And I think this, you know, it's interesting to come back. You're talking about programmers. Anil Dash made this point that I thought was really useful. It's actually surfaced in conversations I've had with my good friends who are software engineers. We all have in our jobs, right? The stuff that's like the fun stuff and the drudgery. All of us have some version of that. And the reason programmers are so insane about cloud code is because it's doing the drudgery and they're doing the fun stuff. In the world of programming, it perfectly does, partly, I think, because the models are built by coders. Like, again, to come back to the embodied sociological reality of this technology, which was not just like, handed down from heaven. Right. You know, my friend even said this to me. He said, a session of work used to be like, fun stuff, drudgery, fun stuff, drudgery, fun stuff, drudgery. You sort of would like be sort of toggling back and forth. It's like, for you and me, it's like when we're like, if you're doing footnotes. It's now just like, fun stuff, fun stuff, fun stuff, fun stuff, fun stuff. And then like in parallel sequences, it's like someone's just like doing the drudgery and it's awesome. I'm more productive. It's better. And it's like, when you describe it to me that way, I'm like, well, that does sound awesome. But again, the question of, is that how it's going to be deployed? Is that how people adopt it? You know, the fun stuff, when we talk about fun stuff, we have fun jobs. We won the lottery. The doing intellectually stimulating work. Like a lot of people don't. And a lot of people also don't, aren't lucky enough to have been introduced to thinking or writing in these endeavors in a way that is fun and is creative or does make them feel good about themselves. It is drudgery to them. And so you do really worry about this kind of mass automation and then this just mass atrophying of people's brains, similar to what we saw happen to people's health and fitness in the dawn of like, it does, you know, modern supersize me capitalism. Yeah. Well, and also, like, the—I love the— Ethan Mollick, I think it has the phrase, but the jagged frontier of AI, right? That this is, like, what you're saying with coders, like, seeing this, like, unbelievable, like, how could you not— how could this tool not be handed down from heaven because of look what it does for me, right? And look how transformative it is, versus like somebody who like paints all day and is like what are we doing This is just stealing my paintings and letting people make paintings and not pay me for the paintings Like what have we done? And like, there's part of that. But I do think in that sense, if the people on the, on the frontier part of it, right, that have achieved that start making the decisions. And this is why like the discourse on X and these types of things freak me out sometimes. It's like you get to make the decisions about how the rest of the people whose lives and careers and jobs haven't caught up, they get to make those decisions. And then before you know it, the people who really can't need to object, who are like, no, no, no, no, this is like actually like the foundation of creativity. We need to maintain this. It's like, no, it's just not economically viable anymore. Or no, you can't have a job that way. And that to me is a scary proposition. Yeah. And I think, you know, when I think about the sort of backlash to it, and I think about the resistance to it, like I don't want the backlash and the resistance to go away, even though it's interesting because at one level, I want to sort of say to people that are on the political left or sort of share my values, like this actually is an incredibly meaningful and transformational technology. It actually does have like really clear use cases. There are ways in which it might make the world better, like 100%. Also, like you don't have to use it and you don't have to swallow the Kool-Aid. Like, if you want to go to a protest at the local data center, like, good on you. Like, I sort of feel both those things. But once I think people grapple the reality of it, I think there's kind of a, there has to be a kind of productive synthesis between how different people are encountering exactly that jagged frontier. Like, why should a painter be psyched about this? This is a great way to segue into the politics of this. Because as you said, and as I believe, AI is on like a collision course with electoral politics that I think is going to be very meaningful. NBC News did this survey that's like so staggering. I thought 26 percent of voters say they view AI positively, 46 negatively. AI ranks less favorably than U.S. immigration, customs enforcement, Donald Trump, Kamala Harris, the Republican Party. Feels pretty notable to me that it's just incredibly unpopular or people have these strong skeptical feelings. The grassroots opposition to data centers is really like kicking up and it feels like it's going to be a thing. Tell me how you see the battle lines that are being drawn here, you know, as we approach the midterms, but also, you know, as we approach 28. Yeah, I wish that I, again, I don't have anything more prophetic than the observations that we're all dealing with. I mean, obviously, there's a growing backlash. I think it's a rational assumption on the part of most people that a thing being built by billionaires who who say every time they're front of a microphone, it's going to put millions of people out of work is not going to be great for most people, which is not to say like sometimes masses of people are wrong. Sometimes the majority is wrong about stuff. And sometimes backlashes are built out of nothing. I've seen it happen. But this, to me, I think people have good reason to be fearful and to be skeptical and wary. One of the things that I think is inescapable about the technology is how concentrated it is, right? So think about, take a step back for a second. It requires enormous, nearly unprecedented amounts of capital to be invested to deploy nearly unlimited amounts of compute. Now, compare that to the structural nature of the Internet, which was created in a non-commercial environment in which there was zero profit motive, in which it was created purely for continuity of government purposes at first and then communication between research agencies. and whose entire guiding structural engineering philosophy was distribution and non-concentration. And now compare that to a technology whose entire inherent philosophy engineering is as much power in as concentrated hands as possible. That's a challenge, man. You know, Dario says this the other day in a podcast about like thinking about it like the way cloud computers are. This is naturally a concentrated industry. And it's naturally concentrated in people that are going to be the companies that are going to be some of the most powerful that exist. What will be the levers under those conditions that produce benefits for ordinary people? Like, and people don't get steamrolled. Right. And so I think that's the way I think about it in terms of like political economy. Now, the question is, well, how do you operationalize that is really complex. And I'm going to just admit that I don't know. I don't know the right answer. What's the right regulatory framework? I mean, you know, the two examples I keep thinking of are the Fed and the FDA, right? Which is like, oh, interesting. We don't want Congress voting on every, like, every drug to come to market. And we don't want Congress, the president, like, deciding interest rates. Just the way that, like, I don't think we should, like, be, like, the president gets to decide what models get released, right? There are areas that we have had to build institutions in the modern regulatory state to deal with a very technically complex area that we still want democratic control in which we create mediating institutions, which, by the way, are under attack from both this conservative Supreme Court and the Trump administration, like precisely this kind of institution, the FTC, the FCC, the CFTC, the SEC, the Fed, the FDA, right? All of these are created for the same purpose. There's some really important, technical, powerful, high risk, high possible cost, high reward area of activity. The modern state needs democratic control and accountability of. But you do not want to just have like plebiscites on or Congress voting on. You've got to create this kind of mediated technocratic space that's sort of halfway in between. It seems like the opposition to this is relatively bipartisan in an interesting way with different quirks and whatevers. I'm just curious, do you see anyone party-wise in a better position here? Does anyone seem poised to deal with this in a way that's going to be fascinating or is it a jump ball? it's a right now it's a jump ball ben yeah this is the word you know ben collins the onion my former colleague was talking about a jump ball the other day and you know desantis had some populist rhetoric about it the other day bernie sanders has been doing some interesting stuff um one of the things he's calling for his national data center moratorium i'm not personally sure if that's the right policy but it's like at this point somebody doing something people are trying stuff yeah i think it's totally a jump ball and i also think it's one of those places where the distance between the power elite, the richest people in the world, the most powerful people in the world, and the rank and file is so enormous. And you're going to see this crazy cross pressure because these politicians are in rooms with their donors and at fancy conferences with all the people making them all this stuff or telling them all this stuff about it. And then they're going to go back home and get yelled at about electricity prices and data centers. And they're going to be totally pulled in two different directions. So the political economy of this is really, really interesting. And I think it's going to be very interesting to see who navigates that and how and which parts of those went out. I think Silicon Valley is in for like a really interesting reckoning with this in the sense too that like the people who are really into this technology too are also a lot of the people who are like, get your hands off my social media moderation. Like, I don't like the free speech, whatever thing. And yet what they're doing is building these like three companies that have taken all of the world's information and just consolidate it and put a bunch of opaque, unknown weights and references to then spit out convincing canonical answers about every fact ever. And it's like, oh, dude, it's coming for you. Including, this is, here's the frontier, man. Here's the frontier. How are people going to go find out about politics and the candidates? Right. And what answer is that model going to spit out and who is going to be in the wiring of that model a la elon musk and the weird thing that he did the model around white south africans that made grok talk about the boar war i i you know it's real cynical of you chris to go after the guy who was responsible for the mecca hitler stuff to suggest that there would be any weird nefarious meddling here okay i i mean that's real disingenuous We cannot, I should say, for the purposes of journalistic rigor, I can't prove that he did that. Something weird happened to the Grok model. It's true. He just owns the company. That's all. He owns a company whose model started spitting out reliably answers that aligned with his politics. But the reason I say this is, you know, this is replacing what for you and me was Google, right? And it's going to be the portal for information. and imagine the power of being able to control what that information was about who's running for office and what they stand for and who you should vote for. I mean, that to me is a frontier that we haven't breached yet. And again, I think the models are so emergent at this point that I don't mean to, I don't think anyone's doing anything along those lines, like in the wiring of the models, but that's a real possibility. And it's also the kind of ominous note that we like to end Galaxy Brain on so that people can go and shift from whatever they're watching or listening to this to to just staring into the middle distance. Yeah, to give you the bad feeling, exactly. Yeah, we're back at the bad feeling. Amazing. Chris, thank you so much for coming on Galaxy Brain. I appreciate it so much. I really, really enjoyed that. That's it for us here. Thank you again to my guest, Chris Hayes. This episode of Galaxy Brain was produced by Renee Klar and engineered by Miguel Carrasquill. Our theme is by Rob Smersiak Claudine Abade is the executive producer of Atlantic Audio And Andrea Valdez is our managing editor If you liked what you saw here New episodes of Galaxy Brain drop every Friday You can subscribe on the Atlantic's YouTube channel Or on Apple or Spotify Or wherever it is that you get your podcasts And if you want to support this work And the work of my fellow colleagues You can subscribe to the publication At theatlantic.com Slash listener That's theatlantic.com Slash listener Thanks so much, and I'll see you on the internet. exploring the world in yacht-like luxury. Join us for a 12-day voyage with the Atlantic. Discover the sailing from Montreal to Boston and more at seaborne.com.