Summary
This episode explores the rise of AI-generated influencers selling products online, examining how synthetic avatars like Milanski are deceiving audiences, the regulatory challenges in addressing this trend, and the broader implications for trust, media literacy, and the influencer economy.
Insights
- AI avatars lower the barrier to entry for influencer marketing, eliminating costs of human talent, studio production, and product sampling, making scams at scale economically viable
- Disclosure of AI status does not guarantee audience skepticism or behavior change; many consumers knowingly engage with synthetic influencers if the content resonates emotionally
- The wellness and supplement industry is particularly vulnerable to AI-driven scams due to low regulatory oversight and audience willingness to trust unverified health claims
- Legislation lags behind technology velocity; New York's synthetic performer disclosure law is difficult to enforce against anonymous, internationally-based creators
- The prevalence of AI content is eroding societal trust in all media, creating a 'Liars' Dividend' where even verified authentic footage is dismissed as deepfakes
Trends
AI-generated influencers becoming mainstream marketing tools for supplement and wellness brandsContent volume as competitive strategy: brands and creators posting same message multiple ways to game algorithmsErosion of media literacy and verification instincts due to AI saturation and content fatigueShift from human-scale scamming to exponential AI-scale fraud with agentic systemsNormalization of synthetic media in political and institutional communicationsGrowing audience indifference to authenticity if emotional/aspirational value is deliveredDecoupling of identity from influence: content quality mattering more than creator authenticityRegulatory focus on deepfake pornography over commercial scams despite economic harmRise of AI influencer creation tutorials and 'influencer studios' as accessible DIY toolsBrand differentiation through authenticity pledges (e.g., Aerie's 'real people only' commitment)
Topics
AI-Generated Influencers and Synthetic AvatarsSupplement Industry Scams and Wellness MisinformationContent Moderation and Platform AccountabilityAI Disclosure Requirements and RegulationMedia Literacy and Audience SkepticismDeepfake Detection and Technical TellsAlgorithmic Content Optimization and Volume StrategyInfluencer Marketing Economics and Labor DisplacementTrust Erosion and the Liars' DividendDisinformation and Political DeepfakesAnonymous Creator Networks and AttributionAI Audio and Video Generation CapabilitiesGenerative AI Tools and AccessibilityBrand Safety and Influencer AuthenticityInternational Enforcement and Jurisdiction Challenges
Companies
Doublespeed
AI company funded by Andreessen Horowitz that automates bulk content creation for influencers
Graphite
SEO company that identified the 'slop tipping point' in November 2024 when AI articles surpassed human-written content
Shopify
E-commerce platform sponsor offering tools for entrepreneurs to build and grow online businesses
Aerie
Apparel brand that pledged in October to use only real people and never use AI-generated bodies in marketing
Higgs Field
Company offering AI Influencer Studio, a modeling agency-style platform for creating and managing AI avatars
New York Times
Publication where guest Tiffany Hsu works as technology reporter covering AI influencers and disinformation
People
Charlie Warzel
Host of Galaxy Brain podcast discussing AI influencers and synthetic media trends
Tiffany Hsu
Reported on AI influencers like Milanski and tracked creator Jose Maria Silvestrini; expert on disinformation
Ken Benzinger
Co-authored investigation with Tiffany Hsu tracking AI influencer creators and supplement scams
Jose Maria Silvestrini
Creator of AI influencer Milanski; runs network of synthetic avatars promoting supplement brands
Zachary Galiah
Quoted on the competitive pressure of content creation and algorithmic attention capture
Tim Caulfield
Expert quoted on how scammers exploit AI avatars in wellness space to make money
Benjamin Netanyahu
Subject of deepfake allegations; posted proof-of-life video addressing six-finger AI detection claims
Quotes
"Every post is a battle for three seconds. Platforms keep multiplying, content is seemingly endless, and attention spans are shorter than ever."
Zachary Galiah (quoted by Charlie Warzel)•~2:00
"She's not a person. She's an AI avatar who looks stunningly like a real person and has apparently fooled many, many of her followers that she is an honest to God human being."
Tiffany Hsu•~8:30
"People have realized that AI avatars is a great and easy way to make money. And now the scammers are like, hey, hey, hey, let's hop in on that."
Tim Caulfield (quoted by Tiffany Hsu)•~32:00
"The more that this technology comes into our lives in mundane ways, the more we expect to see it in these unprecedented really high stakes ways and the more that people can basically say whatever they want to say and have plausible deniability."
Charlie Warzel•~48:00
"Are we at a state where we really don't care who is behind a major cultural figure? And it's really just the image that they're putting out or the product that they're putting out that is more compelling to the audience."
Tiffany Hsu•~55:00
Full Transcript
You have to create such a ridiculous volume of content and it all has to feel fresh. Yeah, I can totally see why someone would be tempted to just make it on a computer. I'm Charlie Warzell and this is Galaxy Brain, a show where today we're going to talk about AI influencers. There's this post online that I think a lot about. It's from Zachary Galiah, who is this social media content strategist. It reads, every post is a battle for three seconds. Platforms keep multiplying, content is seemingly endless, and attention spans are shorter than ever. Your content needs to capture your audience's attention immediately and hang on to it for dear life. Maybe that stat makes your stomach drop a bit as it does for me. What's unquestionable though is that the war for attention, which is fought primarily online across this host of algorithmic, infinite scroll platforms, is being fought at almost inhuman speeds. Obsessive content marketers are in the volume game. Brands and influencers have adopted this buckshot style approach to hawking their wares and attracting eyeballs, and that can mean doing multiple posts about the same subject or product, but from different angles and locations, all to see if they can find some way to hit that sweet spot of the algorithm and go viral. It's spamming as a strategy. And I think it's a part of the reason why our feeds just feel so cluttered and chaotic. And trying to feed the algorithmic beast at these inhuman speeds has meant enlisting the help of, well, not humans. Late last year, the venture capital firm, Andries and Horowitz, invested in a company called Doublespeed, an AI company that does quote, bulk content creation. In other words, it's a bot farm. Doublespeed's marketing is purposefully trolley with claims that it is quote, automating attention, allowing people to create quote, one video a hundred ways. The banner on the company's website reads, never pay a human again. Now it's no secret that the internet is filling up with synthetic material or AI slop. The SEO company graphite recently found that beginning around November 2024, the internet experienced a slop tipping point in which the quantity of AI generated articles being published on the web surpassed the quantity of articles written by humans. But it's not just text. Advances and generative AI audio and video have meant that it has never been easier to create fake influencers from a few short text prompts. These are real looking people, often attractive, sometimes scantily clad women, and they're selling real products. They're attracting real eyeballs. Now some of these online influencers are pretty easy to spot, but others are good enough that they're duping people. And in some cases, it seems almost impossible to know for certain whether a specific influencer is real or not. We are, in essence now, just living in the uncanny valley. The stakes are real for influencers who are worried about their jobs, but also for all of us, the people who are out here navigating this blurred reality and just trying not to get scammed or duped. So are AI influencers here to stay, or are they just this passing fad? Has the internet tipped into a synthetic slop for good? How can people learn to spot what's real and what's fake? To help me through all of this, I spoke with Tiffany Hsu. She's a technology reporter at the New York Times who covers the information ecosystem, including foreign influence, political speech, and disinformation. Tiffany's been reporting on the rise of AI influencers selling supplements and other products. And she joins me now to make sense of this very strange new world. Tiffany, welcome to Galaxy Brain. Thanks for having me. So I wanted to start here. Let's just talk very broadly. Who is Malanski? Am I even saying that name right? Who is that person? Well, first of all, she's not a person. She's an AI avatar who looks stunningly like a real person and has apparently fooled many, many of her. I think it's now more than 300,000 followers that she is. An honest to God human being. She's not. She's AI. She is meant to be an Amish lady who has several children who posts about what you shouldn't eat, clean living. She talks about how she would never buy supermarket rotisserie chicken, which I saw as a personal front. She talks a big game about health and wellness, which is kind of surprising given that she does not have a body. And that's because she's a generative AI avatar, correct? Exactly. So how did you stumble upon this account? Maybe more broadly, we can talk about how did you become interested in AI influencer avatars in general? And also, I think specifically, how did you stumble upon this one and decide this was an area of reporting in Corey? So a mom friend actually texted me one day and she said, so I found this account and pretty sure it's not a real person. I'm pretty wigged out. What do you think? And I've been running about AI for a while now. I see a lot of AI. I know what the usual tells are, but I looked at Milonsky and I was like, this is incredible. Just purely from a technical standpoint, she's very impressive. And so I popped the link to her account into the group chat with the other disinformation reporters at the Times and it just blew up. My colleagues were like, what the hell is this? How do they manage to get Costco looking so real? Like down to the labels of the products that she's holding up in the aisles that she's walking through. So we were kind of stunned at how sophisticated her account was. You have tracked Milonsky down to Milonsky's creator or whatever we're calling this, the creator of a creator, Russian nesting doll of individuals here, Jose Maria Silvestrini, who is this entrepreneur you describe as using these AI avatars to promote brands. Some of them are linked to, as you report, supplement brands, which is its own industry that is dubiously regulated and kind of a little bit of a wild west in some ways. But what did you learn about Jose Maria? My colleague, Ken Benzinger, who I wrote the story with, managed to track him down. We were actually pretty surprised that he was willing to talk because for the fact that there are countless posts on social media from people being like, DM me for tips on how to make tens of thousands of dollars, hundreds of thousands of dollars on AI influencers. It's still pretty murky and people are not especially willing to chat, but Jose Maria was like, yeah, dude, let's talk. So I should back up and say that Milonsky is not Jose Maria's only game. He's got a network of creators that he's kind of supervising, but he's not the one who's creating the avatars. He outsources their creation to other people, and he basically pays them to talk up his products. So a way maybe to think about it right is he is both the creator of this supplement product and also in a way almost like an agent for these fake influencers for his product. Like he kind of has this stable of people. There's a great picture in the article of him sitting at what looks like, you know, like Parisian style outdoor cafe. He's smiley, he's got the laptop. What was his attitude towards this? This is just the brave new world of business. Get on board or be left out. Yeah, basically. I mean, in his mind, he's building the brand. You know, he's like score. I got a mention in the New York Times, got some earned media out of this. I think for a lot of folks who are creating these AI avatars as influencers or as advertising vehicles, they don't think it's sketchy. Even though a lot of them, including Milanski, don't disclose that they're AI. To them, it's just a more cost-effective, efficient way to market something. You are able to create an avatar from scratch using AI. You can customize them to do whatever you want, to look however you want, to pitch whatever product you want. You don't have to pay the fees that you normally do. While researching this, I went online. Always a dangerous thing, but I went online and I looked at some of the people who are selling tutorials on how to create AI influencers. They have taglines like full guide to making 30,000 a month with AI influencers. There's one company that's pitching how to create beauty influencers specifically, which is really weird again, because if you're AI-generated, you don't have skin to use skincare. But the ad for these tutorials says you don't have to pay for influencers. You don't have to pay for studio shoots. You don't have to pay for the products to be sent out to you. We can make avatars that show a morning routine that can replicate bathroom lighting, that can do simple product close-ups, casual camera angles. It's really easy to replicate that authentic feeling that makes human influencers so popular. Not only that too, right? I found this great PowerPoint presentation made by this marketer online at the end of the last year that goes through the digital trends of the year. It's obsessive. It's over 300 pages. It's talking about what brands, what influencers need to do. One of the things they were showing is I think they used Wimbledon from 2025 as an example. It was like Wimbledon had posted thousands upon thousands of social clips during the tournament, which is only a couple of weeks long. It's just more content than you could ever imagine. The idea was this is the strategy. It is total bombardment. It is many, many times a day. If you're an individual influencer, not a brand, you should be posting the same message like four different ways, like from four different types of locations. Try it at the bus stop, try it in your bathroom, try it at the grocery store. See what hits, right? It's just this constant sense of iteration to see what the algorithm is looking for that day, what it's going to reward, then going back and doing that. It seems to me that these AI avatars are like, that's a godsend for this, right? Because you can have all those at bats just by creating these prompts. Yeah. You copy-pasta yourself or you copy-pasta your own AI avatar, I guess. Right. But yeah, it's just so much easier. I've talked to a lot of influencers in the past who said the job looks easy. You're just pointing a camera at yourself and you're talking to it, but it's actually really labor-intensive because of exactly what you said. You have to create such a ridiculous volume of content and it all has to feel fresh. Yeah, I can totally see why someone would be tempted to just make it on a computer. But first, a quick break. Ready to launch your business? Get started with the commerce platform made for entrepreneurs. Shopify is specially designed to help you start, run and grow your business with easy customizable themes that let you build your brand, marketing tools that get your products out there, integrated shipping solutions that actually save you time from startups to scale-ups, online, in-person and on-the-go. Shopify is made for entrepreneurs like you. Sign up for your $1 a month trial at Shopify.com slash setup. What have some of those influencers you've spoken with? What do they make of this trend? Is this existential for them? Is this kind of like, oh, well, they can't do what we do. Where are their minds around that? I don't know that I can exaggerate the number of times I've heard the word panic from influencers because they're like, oh my God, these computer bots are coming for us and it's true. I think they realize that what they do is so easily done now by a computer that they have to differentiate themselves somehow. I know some of them are hoping that legislation is going to help them. Let's be frank, it's not. Legislation, when it comes to AI, is never detailed enough and it's always behind just because AI itself moves so quickly. There are laws. There's one in New York that goes into effect in June that requires disclosure. But then you get into the whole thorny issue of whether or not the audience cares if an influencer is AI-generated. Let's say that Milanski did disclose that she was AI-generated. You could really make the argument that, A, people aren't going to see it. We see this a lot with AI where even if there's some sort of note somewhere that says this is an AI-generated piece of content, you go into the comments and people are like, whoa, this is crazy. I can't believe this happened. Or, wow, you're so gorgeous. What's your number? Or the second possibility, and to me, this is a really scary one, is that people just don't care. They're like, we know you're a collection of pixels, but we like what you're saying. We like what you're showing us and we are influenced. I'm seeing that. I'm seeing that a lot. I saw a video of this blonde woman who looked like a soldier named Jessica Foster who at scroll speed fooled me. I didn't really pay much attention to it. But then I went back up and I was like, wait, Donald Trump's meeting with this soldier and the oval. It kind of, it's, Spidey sense went off. The thing that I saw, the post I saw that I felt really captured this well was, well, what's the difference between this fake soldier woman and some of the other people who are real, who some of these same men we'll see on Instagram, both are unattainable in the same way. As in unattainable, not in a dating sense, but in like, I'm never going to meet this person. I'm never going to live the life. I'm never going to have access to the spheres of where they are, whether that's on a battlefield or in the oval office or in Hollywood or in a penthouse by a pool. I think that that's a very real thing for a lot of people. The influencer is meant to be an avatar, even if they're real, for a life that is aspirational. An AI avatar can do a lot of that. It's going to be just as hard for someone to feel like it's attainable. Yeah. I mean, influencing at its root is an exercise in wishful thinking. So it doesn't matter if you're hoping fruitlessly that you're going to be this real person or this AI-generated person. My team normally covers disinformation. We came across this idea a lot when we were covering the hurricanes a while back in North Carolina where there were a lot of AI images being posted of the devastation. There was one showing, I think it was like a little boy, I want to say, who was sitting on a raft with a dog drenched crying. So this image gets posted by a local Republican official and immediately people on X are like, this is AI generated, this is not real. And she responds in kind of a stunning way, which is to say, I don't really care where this image came from. It hurts my heart or like the feeling is real. And what's happening a lot on social media, just because there's so much content is that people are getting fatigued. They are so exhausted at having to parse what's real and what's fake that a lot of them are just saying, if it makes me feel a certain way, that's all I care about. But do you think that fatigue goes the other way with people saying, you know what, I'm becoming generally over the influencer thing because of the fact that it's like, if you're not even going to invest the bare minimum humanity into this product, this product is used by actual people in some capacity, I'm going to bow out of it. Do you think it could sort of erode and taint the whole idea of the influencer ideal or do you think maybe it just super charges it? No, I think you're totally right. Aerie, this broad company posted in October this pledge that they were only going to use real people. So they said, like a few years ago, we stopped retouching our models and now we're going to pledge to never use an AI body. And that post was by far their most popular post of the entire year. I think you have a lot of brands that are catching on that people are over AI influence. But then, then on the other hand, you have avatars like Etana Lopez. She is described as an influencer who's based in Barcelona, who's a fitness girl, she's pink hair. I mean, she discloses herself as being AI generated, but she has like nearly 400,000 followers. She has been posting photos of herself in like Chiaparelli dresses at Paris Fashion Week. She's got like a brand deal with Aloniova. Her creators have been quoted saying that she makes up to like 10,000 euros a month. So I think there is some resistance to this trend, but you know, they're still really popular. Do you feel like some of this is just a literacy issue or do you feel like, again, it's really a change in what we expect, what we consume and a lack of really caring? So I think that's a really good question. I think the answer is it's a little bit of both. I did a story late last year where I shadowed a high school class and they were learning about disinformation and media literacy, but they have really interesting perspectives on AI influencers, which they independently brought up to me where they said, you know, some of them are really hard to identify as being AI. You know, a couple of them mentioned after Sora came out, there were a series of posts that featured Jake Paul, the YouTuber, supposedly embracing his queer identity and like doing makeup videos, whatever. And there are a couple of the kids were saying, we were almost duped by that. And so for them, in part, it's a media literacy issue to know that AI is capable of producing stuff like that is something that they want a lot of their peers to be on top of. But on the flip side, they raise a perspective that I think journalists often forget now just because AI is so crazy, which is that AI is really impressive. Like it's used to create incredible things. So a lot of these kids are themselves experimenting with like Google Vio or Nano Banana Pro or Sea Dance. And they're, you know, they're playing. And so to them, having the possibility of influence via AI avatar is like a fun thing. You know, one of them mentioned this influencer studio. It's basically like a, it's like a modeling agency, but for AI avatars, it's from a company called Higgs Field. They have a program called AI influencer studio. You can pick from so many different options. It's like a Sims for the new age, right? You can choose whether you want your avatar to be like human and ant or aniguana or elf, right? You can choose genders like trans man or non binary. You can choose like skin color, eye color. You can choose like a skin condition that includes like burns and dry cracked skin. They have settings like forked tongue, big or small horns or like fish skin. So I think to a certain demographic, like messing around with this is a really great time. Right. And that makes sense. I think it's, it is important to keep in the context here. There's sort of two buckets of this, right? One is that bucket of being able to play around that these are tools. These are forms of AI, you know, detractors and critics will probably bristle at the phrase, like there is an art form to this, a creative expression formed to all of this. I think we can't discount how it can be fun and it can just be like a different way for people to move through the world with these avatars, right? And then I think even in the, in the brand space, in the selling space, right? Like we got Tony the Tiger, we've got things, like we've got people who sell things that aren't real, right? And yes, it's, it's obvious that there's not like a talking tiger who's real and selling you cereal or whatnot, but there is this idea of like characters sell things they always have. They always will. Brands have mascots. And so I think like, I think there's precedent, probably, for a lot of this stuff. And there's a lot of this that isn't like pearl clutching panic. And yet I think what interested me about your story that you did with Ken and the reporting is the way to, in which it overlaps with this world of, of less than regulated supplements and things like that, right? That seems to me to be the concern here, right? Is that in this moment where we're all figuring out how to understand this, how to read this, you know, up our literacy on all this, you have this group of people who are moving in and they're actually trying to take advantage of the fact that there is a lot of confusion in this space. Oh, yeah. Oh, yeah. I talked to Tim Caulfield, who is a professor of health science up in Canada. And he put it pretty succinctly where he was like, people have realized that AI avatars is a great and easy way to make money. And now the scammers are like, hey, hey, hey, let's let's hop in on that. And the wellness space has always been a magnet for scammers. I'm a mom. And I remember both times I was pregnant, like the absolute amount of insane content I would get served on social media. And the idea that fake people who seem real could be selling that sort of stuff to me with like a voice of authority is pretty scary. Because I think more so than like fashion or beauty, like wellness stuff. People are really willing to trust because most people don't have the kind of science background you would need to really parse through what is snake oil and what is like a legit thing. And so if they see someone who seems like they know what they're talking about and who seems to be talking from experience, you know, they're more inclined to trust. And so wellness scamming is it has a long illustrious history of bullying a whole lot of people. And you're right, the presence of AI avatars in that space is only going to make that worse. So when you were doing the reporting and it led you all to this guy, Jose Maria, who's sort of the the keeper of this, the guy running the brand, but not making the avatars themselves. Did you all get into, you know, how these avatars are created? There's obviously these these programs that exist. But like the people who are sort of mercenaries for some of these folks, right? Did you get a sense of like where the hotbeds of this AI avatar creation are? Because it's so easy to make an avatar. You don't even need to be working in conjunction with other people. You know, this can be like a do it yourself thing. There are there, you know, there are guides all over the Internet teaching random people how to how to do this. I could probably do it if I felt like it pretty quickly because the the regulations are so confused and they're so lax. Not a lot of the platforms that offer like AI generation are going to stop you from creating an avatar. Because there's nothing inherently illegal about creating a faith person who says certain things about a certain product. You could run a foul of rules about scamming, but like the platform isn't going to be able to monitor that. It's not in their interest to put in a lot of resources into overseeing like how people are using the characters that they created with the program. Well, and you mentioned with regulation that in December, Governor of New York signed the nation's first legislation and that explicitly required this disclosure of quote unquote, synthetic performers in certain advertisements. You said it's kind of DOA in some sense, or it's just not really going to like it's not going to have this impact. Can you say more about that? I think it is helpful to have the legislation just because it sets a precedent for other attempts to regulate. And, you know, I think the more practice lawmakers get trying to regulate this the space, the better they're probably going to get at it. And, you know, it also demonstrates that the authorities care that they recognize that there's a problem, even if the way they're going about issuing consequences is a little bit hazy. I mean, it's just so many of these creators are anonymous. A lot of them are operating from outside the country. I mean, this is this has been a problem with all sorts of AI legislation, whether it has to do with deep big porn or like political deep fakes. Dealing with commercial scampers is not super high on the average of legislators priority list. The deep big porn is the area that most folks are really, really up in arms about at the moment. But even there, it's like it's it's also a volume game, right? It's like if you were going back to the old paradigm of like people scamming, like, you know, these things are are conducted at sort of like human scale and now at artificial intelligence scale and with agentic AI, you know, in the swarms of, you know, like agents and doing stuff like it just sort of exponentializes the the ability to do this stuff. So it seems like it goes from whack-a-mole to like some inhuman game of whack-a-mole. I talked to a lot of victims of of deep big porn or like AI generated threats. And some of them have said that they've they've complained and they've managed to get the the platforms to either block or remove the the responsible accounts and then another account pops up like a day later and starts targeting them again. It's like turbo whack-a-mole. Exactly what you said. Where do you think this goes from here? Because I get this sense that we're in. I think I can talk myself into it two different ways, right? That this is the first inning of a very long game, the likes of which are going to get stranger and stranger and more dystopian, although, you know, maybe we grapple with it. And the other, I think, too, is this idea that, yes, the world is getting weirder, more unpredictable. There's more tools for scammers and folks like this. But also this, like we were talking about earlier, this exhaustion in this, you know, of being bombarded by this digital stuff, this sort of the Internet becoming less and less human and people dropping out or stop or, you know, not not finding themselves all that interested in it. When you think about what you're trying to anticipate and what's coming next, do you fall into one of those two camps? Do you have to have a different thought about where all this goes? Giving our track record as humans, I'm not incredibly optimistic about us, you know, putting our foot down collectively as a society and saying, stop this AI nonsense. I do think we're going to run into a lot of issues with societal trust. I mean, that's already happening. My colleagues and I just wrote a story about the Liars' Dividend, which is the phenomenon that happens when the prevalence of AI makes it so that people can more easily discount, like, actual footage, real footage, which is what's happening with the proof of life video that the Prime Minister of Israel has had to circulate. Explain that for a second for people who will be less informed about this idea that Israeli Prime Minister Benjamin Netanyahu is dead. And explain that just for a second. Oh, God, how many hours do we have? So in a nutshell, Netanyahu gives a speech that is recorded and in the reshared versions of the recording, in certain frames, he kind of looks like he has six fingers on one hand. Now, extra fingers is or was a pretty common tell that AI was involved. Now, AI has gotten much, much better. So that's not really the case anymore. Versions of that video start circulating where people are like, oh, my God, he has six fingers. This is AI generated. Obviously he's dead because we always jump to that conclusion now. Is that the world leader is dead? So amazingly, a few days later, Netanyahu posts on his social platforms, a video of himself at a cafe outside of Jerusalem, just circulating very clearly with his five-fingered hands. I mean, this is it's a proof of life video. And as far as I know, it's the first proof of life video to like directly address being deep faked from a world leader, especially when it's prominent as him. OK, so he posts this video. It is verified in several different ways. The cafe itself posts its own set of images separately from Netanyahu's, showing him like ordering and talking to people, deep faked professionals, analyze that video frame by frame. They're like, we don't see any signs of digital manipulation here. Regardless, the internet goes, this proof of life video is also generated. You have people, some of them like millions of followers, host copycat videos of like the new leader of Iran doing the same things that Netanyahu did in that cafe, or they show Netanyahu like we're a sports jersey in the cafe just to prove how easy it is. And so the narrative just spiraled. It's like people don't trust the proof that was provided in response to the initial distrust of video crew. Doing reporting on all this disinformation stuff in like 2016, 2017, 2018, there was so much of this idea of you think these photoshopped images are bad. Like just you wait, wait till the AI stuff comes. And like, you know, the AI stuff was like in the realm of like the really bad videos of Will Smith eating pasta where his mouth detaches from his body. And there was sort of this like, OK, yeah, I can see that happening. But this idea of like, no, no, no, the lines of reality will blur so fully that it just will be a free for all. And I think that there's so many people that received the articles that I wrote about this or the reporting I did and other peoples out there was like, OK, that's really alarmist. And I think it's fair to say that we are just actually living in that future. Like that was a, you know, like 100 percent success rate comparison. And I think that, you know, it's not where I think a lot of people would go with, you know, an immediate jump from AI avatars to this. But you're totally right. The more that this technology comes into our lives in mundane ways, the more we expect to see it in these like unprecedented really high stakes ways and the more that people can basically say whatever they want to say and have plausible deniability. Yeah. Yeah. People are so they're so desensitized to it, too. I mean, we we keep writing about how bold a lot of social media creators are becoming now because, I mean, like the administration is a mean factory. Like we have a president communicate through AI images and like digitally work images of real events. I believe they refer to them as bangers. So that's the White House term of art. I got, oh my God, I got a comment back from the White House when I was writing about this photo of a protester in Minneapolis who had been taken into custody. The original photo is posted by some branches of the government show her like, you know, pretty composed. She's she's walking with an agent and then the White House posts a photo of her like with her skin darkened and she's sobbing. And I reach out to the White House for comment on this and they're like, justice will continue to be served. The memes will continue to be served or something to that effect. And I was like, oh, so this is this is our this is our communication method now. Yeah, the paradigm is completely shifted in that sense. This is a little bit of a swerve here before we land the plane. But something I was thinking about is you said, I think I could create one of these avatars using these programs, right? And I think I believe you. But could I get it to be like highly influential? Like if I had this thing to play with, like, like, is there still a skill game at this? It isn't the slam dunk that people think it's actually like these people are just really good at the game and they just happen to do it, you know, with a costume on. Short answer is yes. I have a long answer. I'm going to tell you about my my journalism white whale, which is that I have tried for years now, I think, to get a mention of my one of my favorite movies into a story about AI, which is the masterpiece called Simone. Do you know this movie? I don't think I saw it. I mean, honestly, it was not popular. I don't think many people saw it, but for some reason I love this movie. So in short, Al Pacino plays a director who's down on his luck because he's like not being successful. So he he essentially creates an avatar named Simone, who he convinces everyone is a real person. Simone goes on to like win Oscars. She like runs for office and wins. And Al Pacino's character at some point is like, oh, my God, I'm creating a monster. He's like puts all of the CDs that Simone is like imprinted on. And he tries to like bury them in the ocean and he gets like accused of murder. It's I mean, it's it's it's a really convoluted, like messy story. But the fact that an AI or a synthetic character manages to convince the entire world that she's real and she is able to exert like huge amounts of influence has always stuck with me. And I think increasingly more so because it seems like something like that could happen now that you could get someone who understands the way media works, who understands the way like Hollywood or social media or audiences in general work. And you could easily have someone who creates a character that really is compelling to a lot of people. So real quick, what I want to do, I want to I want to talk about this a specific Malanski video, the aforementioned rotisserie chicken video with the caption, most people buy this every day. And I would love if you could like walk me through the tells here, how people were just scrolling through their feeds and stuff are going to be able to like distinguish this like, you know, I'm seeing five fingers, for example, that that so it's not that like what are some of these tells here? This is a little gross, but if you look at the way the chicken is dripping, I don't think rotisserie chickens trip quite so quite so lusciously. So there's that. It is disturbing. Yeah, right, right. I don't want to look at that more than I need to. Yeah, one of the biggest tells from Malanski specifically is that if you go to the grid of her of her overall account, you notice that she's always kind of positioned exactly the same way. She's always looking at the camera exactly the same way. She makes very similar facial movements and like hand gestures. That tends to be a tell, but it's hard to it's hard to notice that in like a single video. She's always kind of lit with the same like golden hour light. Like that's what I see from the grid is it always looks like she's it's like five p.m. in the summer, you know, and she's outside. And sometimes it looks like she's I mean, she's inside in some of these. She's like in Costco. I mean, that's that's actually a really good tell is is lighting often with A.I. influencers. The lighting isn't natural. Like it kind of looks like they're being lit from all side instead of just from one direction. If you look at some of the older videos, she looks a little bit different. Oh, wow. That tends to happen with a lot of the longer running accounts. I don't know if this is the case specifically with Polanski, because she doesn't really do super close ups. But sometimes you're able to look into the irises and the reflections are different in both eyes. If you look along the hairline, often it'll look a little blurry or a little out of whack. If there's audio, audio is really, really good now. Audio deep faking, but sometimes they don't breathe like a real person does. There aren't as many like, for example, the way I'm talking, I use a lot of OMS, a lot of a lot of filler words. A.I. avid hearts do that less. But of course, all of these things you can deal with if you're a really good prompter. Yeah. Oh, I'm just I'm just watching this chicken drip. No liquid behaves that way. Anyway, sorry about that to derail it, but I'm half heartened by all of this, right? Because I can still, I can't tell you always what it is. Like as you're walking through that laundry list, I'm like, yep, I see that. The hairline that that one was like novel to me, the zooming in, looking at the irises. But there is just something that my brain still recognizes as like suspect, right? Yeah. And I'm also worried because I'm like, is this the last glimmer? Like is my brain, is this the last flickering of this instinct before I lose it, you know, pre this conversation, cards on the table. I'm sort of it's sometimes hard for me to get really fascinated by A.I. influencers because I'm just like, yeah, that's not for me. You know, that's just like not a thing that like I like, I'm not interested in engaging with an influencer who's not human. And so how could everyone be? And it seems really plausible to me in the same way. It's it's it's obviously very different. But if you were to tell like someone in 1989, this guy, Donald Trump's going to be president, right? Like, like, and people are just going to be like, he's a genius and a strategy master and all this stuff, right? People would be like, OK, that's what I'm thinking about is you're saying this. That's like, yeah, it's not going to happen tomorrow or anything like that. Like we're not going to have, you know, whatever president Simone. Yeah. But I do think it's really interesting to think about all of that and that kind of dynamic in a world where this becomes more normalized and also in a world where maybe that, you know, North Carolina disaster, politician ethos of I don't care that it's not real. It speaks to me. If those things marry in a way, you know, culturally, politically, whatever, I do think it like it really brings up this this question of like, man, like, are we going to get to the place where there's going to be influential people who even have gained people's trust in ways that right now seem really absurd. It seems really plausible in that sense. Yeah, I completely agree. You know, I was thinking in my reporting, I think a lot about like identity and anonymity because so much of the really sketchy shit that happens in my line of work is done anonymously. And, you know, recently, Banksy, the artist, has appeared to have been identified, right? It's like, I think some 50 something year old man in the UK. And it just got me thinking for years, this this guy who like no one could really identify was after like changing the art world and like commanding ludicrous prices at auction. And now that he's been identified, is that going to change any of that? Do people really care? Or is it just the content that they're that they're interested in? And and I don't know if this is like a tortured link back to A.I. avatars, but I think I think the same question is valid. Are we at a state where we really don't care who is behind like a major cultural figure? And it's really just the image that they're putting out or the product that they're putting out that is that is more compelling to the audience. Tiffany, this is, I think, a good place for us to leave it. I'm impressed with where we ended up getting to here from this. And I really feel like now I have now I'm going to go and like actually contemplate like an A.I. avatar politician and stare into the abyss. So thank you for that. I appreciate it. Let's leave journalism and make some real money. Seems easy. I think it's time. I think I think I think I found my offer. Alrighty, same. Let's make it happen, man. Yeah, this is great. I appreciate it. Thank you. That's it for us here. Thank you again to my guests, Tiffany Sue. This episode of Galaxy Brain was produced by Renee Clark and engineered by Miguel Carrascal. Our theme is by Rob Smersiak. Claudine Abade is the executive producer of Atlantic Audio. And Andrea Valdez is our managing editor. If you liked what you saw here, new episodes of Galaxy Brain drop every Friday. You can subscribe to the Atlantic's YouTube channel or on Apple or on Spotify or wherever it is that you get your podcasts. And if you'd like to support this work and the work of the rest of my colleagues, you can do so by subscribing to the publication at theatlantic.com slash listener. That's the Atlantic dot com slash listener. Thanks so much. And I'll see you on the Internet.