Hey, it's Flora Lichtman and you're listening to Science Friday. Today in the show, are you being played? Point systems are everywhere. Ready for movie night? Consult rotten tomatoes. Vettin' a new pediatrician? How many stars do they have? And at work, it's even more pervasive. There's KPIs, ROI's, success has to be measurable. And you may ask, well, what's wrong with that? How else do you figure out if something is good or not, if something is working or not, if you don't score it? Plus, is all scoring created equal? Like, scoring helps make games great? So what's that about? These are some of the big, messy questions that Dr. C. T. Nguyen has been wrestling with. He's a philosopher at the University of Utah and he just published his second book, The Score, How to Stop Playing Somebody Else's Game. Too Welcome to Science Friday. Hello, hello. I loved your book. I stayed up late in the night reading it, which is a big compliment because I get very sleepy and I had millions of thoughts and I know that philosophers love one sentence over simplifications. So if I had to boil the book down, I would call it, hate the metric, don't hate the game. What do you think? That's better than anything I came up with. I feel like you're buttering me up. But thank you. I think it's going to be music to people's ears to hear you rail against metrics. But I think the thing that's really interesting and then I want to talk about right off the bat is that you say that they're not just irritating, that they're actually powerful and that they can change us. Will you walk us through that idea? Yeah. One of the core experiences I had in my life was this kind of drift in my values where I started doing things like starting to diet, trying to get better at rock climbing, trying to get better at philosophy. And at first there was a scoring system nearby and I could mostly ignore it and be like, what I cared about is the interesting questions is feeling better in my body. And over time, there's this drift. What happens with the drift is that I started carrying deeply and immediately about the metric. So I've been calling this a value capture and value capture is what happens when your values are rich and subtle and you get put in a setting, typically an institutional setting, that presents you with some simplified and quantified version of your values. And then that starts to take over. You start carrying immediately about getting more likes or getting more KPIs or getting higher in those rankings. Right. So instead of like making a great podcast, you try to optimize to get the most downloads spot. Yeah. Or like instead of actually caring about connecting to people on social media, you care about the number of likes and follows. The thing that's really worrying about value capture to me is when you get this slide and kind of like deep inside your soul, the thing that you think is important changes and your core expression of your value becomes likes, tweets, KPIs, page views, the status ranking of my university. Another one of my favorite example, I was talking about this stuff and a pastor said that inside his church, they've constructed an internal leaner board keeping track of baptism rates and that all the pastors were getting super competitive and that he'd found his own sermons changing and that he was no longer most attentive to like the spiritual growth of his flock and he was trying to write like more poppy, peppy sermons. It would suck in more people to get up his baptism rates. Okay, here's, but on the flip side, what if your values could be better? You know, because a lot of metrics are put in place to eliminate bias, for example. Like we talk about this in hiring as a way to help us be more objective or combat our own bad values. What do you think about that? I mean, here's, I think you started at the top by saying, you know, we all love to hate on metrics. And I think hating on metrics with this kind of like pure cold fury. Actually, it's kind of a cheap way out because it we imagine, like you imagine this world, this better world without metrics. I think the more painful, painful truth is to realize that metrics are both incredibly powerful and incredibly limited and that their power and their limitations are part and partial of their core function. They offer us clear, simple, objective, unbiased counts, but that there's also an incredible price to that. One way to put it is that metrics are incredibly good at capturing the kinds of things that we can all count together easily. And I think the kinds of things they miss systematically are the kinds of things that people are going to count differently that require some kind of discretion, some kind of judgment, some kind of sensitivity. When I was thinking about bad metrics, one common response people have is to say, look, maybe the problem is just this particular metric is locally bad. Maybe we can just find a better metric, right? Let's just get a more accurate way of counting good education or good health. When I had this gut feeling in my heart that we weren't going to get those kinds of metrics for certain kinds of things, I was. That it was actually impossible. That's something's defy measurement. Yeah, the something defy measurement. I was actually sitting there in a conference about six or seven years ago with a bunch of machine learning experts building the first generation of art making AIs and they were saying, oh, we're doing all this stuff to optimize for really good art making AI. And I was the one philosopher of art in the room and I was like, hold on, hold on, how are you defining good art, right? Like, what's your operationalization? We have amazing if the if those tech bros had figured that out. And what they said was, and this was really striking, they said, we're just using the Netflix database for engagement hours. When I lost my mind, that's not good art. That is that's not good art. That is addiction. You're optimizing for addiction. And what they said back was, show us a better large scale database with a better metric for good art. And we'll use that instead. And I said, I don't think there's going to be one. And that's I think the kind of path I've been going on. I've been trying to get find a philosophical account of why certain kinds of values will ultimately defy metrosization. And I think I found the answer actually in a bunch of historians, particularly two amazing figures, Theodore Porter and Lorraine Dastin. And they really unlocked for me the kind of core dynamic underneath metrics. And it's actually, I mean, it's not about, it's not about like pure science and the pure heart of what is countable or not. It's about the logic of bureaucracy. It's about how large scale institutions work together. Theodore Porter puts it this way. He's really interested in why administrators and bureaucrats often compulsively reach for quantitative forms of justification, even when they're really inappropriate. So he says, qualitative knowledge is rich and sensitive and open-ended and dynamic, but it travels really badly between contexts. So my favorite example as a professor and a teacher is the evaluations I write on my students essays. But what I write is not going to be comprehensible to a business school professor or a CS professor and what they write in their students won't be comprehensible to me. So what Porter says is that when we make quantitative data, we pick a kind of chunk that's going to be steady and stable across contexts. We find a chunk that everyone can understand no matter their background across the institution or across the world. So an education that's letter grade, GPA. And I think you can kind of get a glimpse of what's going on here by just thinking about how different and how rich a qualitative evaluation is and how hard it is to understand at a distance and how quick and easy a letter grade is to understand and how thin and simplified it needs to be. I felt like this was my matrix, the veil is ripped from my eyes moment, was that metrics are powerful because they're designed to be stable across contexts. So we can all understand them and we can all collect into them. And that's what creates this kind of cross cutting, massive, shareable piece of information. But to make that, we had to cut out the context, right? That is actually the design feature and the design bug in one. They are powerful because they're decontextualized. Right. Right. Yeah. Interesting problem. I mean, so metrics are a way of scoring, right? And you talk a lot in the book about your own challenges with scoring and like getting sucked into the score, right? How do you wake up from that? Do you have a story that might confer some practical advice for our listeners? I mean, a lot of the stories involve, I mean, I started doing philosophy out of love and because the questions were interesting. Philosophy is not a great thing to do with your life. I think all my parents and all of my relatives thought I was throwing away a good education. You go to philosophy, right? You're giving up on most things that might be a reasonable way to be a productive human adult to do this weird thing because I loved it. And then I got professionalized. I went into graduate school and I learned that you had to, that there was an internal ranking system in philosophy. And that internal ranking system was based on the status of the journal you published in. And high status journals really liked this very specific kind of extremely technical, extremely dry, extremely disattached from the world kind of work. As I started doing that and I became, I kind of converted my life over to chasing this large scale scoring system and ended up kind of losing in touch with the actual reason that I wanted to do philosophy. And then I got miserable. I got super depressed. I almost quit the profession. And I think in my case, the signal was incredible, boredom and despair. Despair, okay, good. I'll be able to look out for that. Yeah, it'll be on the lookout for despair. I mean, there's a philosopher I love, Elijah Milgram. And one of the things he says is that boredom is this incredibly important signal because it tells you when you've picked bad values. It tells you when your values don't fit yourself and your context. But if you're... That's a deep thought. I like that. And I think here's another thought. If you listen to that, if you listen to that quiet voice, then you might be able to steer away. But if the clarity of the metrics by their clarity and their communicability is so strong, you let that outshout the kind of quiet voice of inner despair, then you'll ignore that. And you'll just keep following the metric. Okay. We've been talking about some of the perils, complications of scoring for the first half of this conversation. But I love this twist. In some contexts, you love scoring because you are game obsessed when we're talking 90s European board games, social games, video games. And before we go to break, I just want to tell you what's coming next. We asked the listeners to call and share stories about games that change their lives. And like so many people had stories for us and we're on board with this premise. But not everybody. Yeah, this is Schrock and Robbie in the drums. You know, I've been listening since about 1987 to NPR and even unconsciously on my teachers car stereo, probably in 1977. You freaking people with your video games. Tell us about a video game that changed your life. It is man be panby topics for young kids. You know, it changed my life here in Motown and rock the boat in 1973. Or Led Zeppelin, the song remains the same. Live, you know that album? No, you don't. It's just a hell of ticking music you're listening to. That's what changed my life. Led Zeppelin, log. What? Let's see if we can change Rock and Robbie's mind. I think I know what to say about Robbie. OK. OK. All right, after the break, what games can tell us about the meaning of life? Stay with us. When some of the scientists who helped build AI are now sounding the alarm, with this kind of technology, aren't we going to build machines that we don't control and could potentially destroy us? What future is this technology rushing us toward? Listen to the last invention. Wherever you get your podcasts. OK, so for someone with, you know, serious grievances with Scorson metrics, you also love games. Does that mean you secretly love points? You know, this is actually where this entire book came from. And a lot of people, you know, when they talk about games, they'll talk about fancy graphics and movie-like dialogue and they'll talk about how much like movies they are. And they won't talk about the thing I love about games, which is the freedom and the choice and the difficulty and the creativity. When I was trying to understand that, I found this amazing moment from Reiner Knitia, my favorite board game designer. And what he said was that the most important design tool in his toolbox was the scoring system because the scoring system tells people what to care about during the game. It sets their desires. And the thing that was super interesting to me was that he had like calmly put his finger on this like weird, deep part about games, which is you can just open a game box up and read the rules and it tells you what to care about. And suddenly you just do it, right? You can literally even my wife and I will open up a board game. Like a messing hotel. So you're like, okay, I want the green ones. I got to get the green ones. Or building a better network of railway trade or killing each other. Or like, and I mean, it's so deep that you can open up a board game. My wife and I will open up a new board game. And then it'll tell us whether we're cooperating to beat the game or whether we're trying to kill each other, right? And you take it and you're like, sure, great, thanks. Right. So what I'm going to do is I'm going to do a game. What this does is I think games are kind of what they're doing is they're shaping ourselves and our agency. They're telling us a different desire set to take on. And then they're designing, they're using that to design this incredibly interesting experience. Like so many board games will carefully design this intricate lock of what you're trying to achieve and what the constraints and methods are. And then suddenly you have to like do hyper careful logical calculation. Or you feel like try to guess what's in people's mind or you know, in other parts of life you have to, in my case, like climb a rock. A game, rock climbing is a game that tells you to get to the top of the cliff using only your hands and feet. And then suddenly you're plunged into this life of like balancing and delicacy. And the first thing I want to say, wait, who is the person that was hating on you for a loving video game? Rock and Robbie. Okay. Rock and Robbie. First claim, games are bigger than video games. My favorite definition of games comes from Bernard Soutz who said playing a game is taking on a voluntary obstacle to make a certain kind of experience of struggling possible. What he was really interested in was that sometimes we take on constraints specifically because we like that struggle. And a marathon, you could have taken attacks that you don't because you want to be running. With climbing a cliff, I could have used a rope to like scale a tree, but I don't, right? I use my hands and my feet on the rock because that's more interesting. Here's another one, rock and Robbie. I think you could have, for a lot of cases, you could have had more perfect music better by playing or recording or playing a written score. But a lot of the times we like to do it ourselves and we like to improvise it ourselves because the challenge is interesting because the experience is interesting. One more thing for rock and Robbie. And I think this is really related to like my core, deep, weird fascination here, which is I'd written a whole book talking about how scoring systems were beautiful in games. And then I started to write a bunch of papers about how scoring systems suck the life out of us and education and institutions. And I was trying to figure out why. And here's the first big difference. It's fine that rock and Robbie hates video games. That's cool. That's because nothing in our normal lives, in most of our lives with games at least, forces us to play a particular game, right? I can play ultra complicated strategic war games and someone else can play like chill, zen out, rhythm games and someone else can go fly fishing. And the interesting thing about games is that you can maneuver through this ecosystem of different scoring systems and different constraints to find the action you love, right? And you can't with metrics, metrics are an escapeable. Well speaking of using constraints to make a beautiful experience, this is a game that a listener invented and I want your take on it. Hello. My name is Connor. I'm calling from New Millford, Connecticut. When one of my dogs passed away, I decided that a good way to help my younger dog, who was still alive, was to hike on the Appalachian Trail. So I started to take her out once or twice a week on the Appalachian Trail hiking and eventually I realized that it was feasible for us to reach 300 miles that year if I had just really focused. So I decided to make a spreadsheet and record all my hikes and I just became absolutely obsessed with it. And I have always loved hiking but this game where I was always second in this spreadsheet has just really changed my relationship with my dog and given me a new hiking companion. Amazing. I have so much to say about the story. So I think one of the interesting things about scoring systems is they can hypermotivate us and they can create this kind of very motivational clarity that can plunge us deeper into a kind of action. The question is, is it an action that you like or you don't? Some scoring systems drag you into boring grinding action, some scoring systems drag you into something that you find rich and fulfilling. And this story is like the ideal story. This is someone that added a scoring system, creating the experience, it was better and they acknowledged that. They're not being sucked into an experience that they do not want, right? They're using the scoring system under control to give them the life they want. Yeah. Here's another amazing game story. This story changed the way that this listener saw the world. Here's Elizabeth in Rochester, New York. So one evening I was playing Latzi with his friends and he'd never played before and we were at the point in the game where we had filled in all the categories and it was his turn and he only had to get Latzi. So he only had one role left and he declares that he's going to roll five sixes. And I was trying to stop him. I'm like, wait a minute, do you know what the odds are? And it's one in 7,776 or 0.01286 percent. But there's no convincing him. So you scoop up all the dice and you guess what happened. Otherwise I wouldn't be calling you about this. He got the five sixes. And anyway, so the way that it changed my life is, anytime I hear these crazy odds, like there's a 0.001 percent chance that a giant meteor will hit the earth in the next few months. I think about this Yachty game and I'm like, they could happen. Yeah. I think one of the things that's really interesting in games is that we can take wild risks in them that we can't take elsewhere because they're detached from ordinary life. This is one of the things you're actually low. The stakes are actually, I mean, so this is not true of every game, right? Some games, you know, if you're a professional sports player, there's real incentives. But for most of us, the game, there's this concept in game scholarship that games occur in a magic circle. And the idea is that the things that happen in the game that we're trying for, the points, don't actually connect to anything in the outside world. And so we're kind of forced to be much more risk of worse in the ordinary world because we're tied to various incentives because those points in the real world are tied to things that we can't escape. They're tied to resources that we actually need in games, right? The interesting thing about a game is you can set up a world, you can go all out, you can try to kill each other, you can try to take huge risks, you can win or lose. And then it just evaporates afterwards. The points don't actually matter. And this enables, right? This kind of wild risk taking. It enables the drama because if this person did that and they failed, it wouldn't actually matter. I think that's, again, one of these big differences between games and metrics. The scoring systems of games are temporary and disattached and distinct from ordinary life. And the scoring systems and metrics aren't. They're kind of inescapable, which means we can't have this kind of playful attitude towards them. What's interesting to me is that games also can be attached to your real life. Here's another call we got about a game that many people have strong feelings about. Hi, this is Fred in Virginia. The game that has changed my life is Dempsey's and Dragons. I found out about it when I was a young teenager. And it changed my life. And I don't know how many ways. I learned about social interaction. I learned about probability. I learned about storytelling. I ended up researching politics and geography and mythology and history. It sparked an entire scholarly interest. Absolutely changed my life. Give me once I can have seven answers. I want to give some of these. You wiping tears from your eyes? I've had the same experience. You have. Some of the most holy and precious moments to me are in the space of Dungeons and Dragons and other tabletop role playing games. For me, in my book, Dungeons and Dragons players in particular people that turn modding the system are the real heroes. The opposite of bureaucracy is house ruled dungeons and dragons. For me, there's one of the core questions behind all of this stuff. Is the question of what strict rules are doing for us and to us? You might think that strict rules push us away from play. I was trying to understand this and I had a yoga teacher explain to me that people think that total freedom is good. But if you give people total freedom of movement, they just repeat their normal habits. And you need the strict rules of yoga to push you into a new posture and help you be flexible. And I think Dungeons and Dragons is one of the clearest cases where the strict rules force you into a new habit of soul. They ask you to look at things from a different angle to approach things from a different character to approach things in a different world. One of my favorite variants of Dungeons and Dragons is a apocalypse world. And often depending on the character you play, it often restricts what you can do. Like one of the characters, the only thing you can do, you can't really attack people, you can't really make money. The only thing you can do is probe their soul for vulnerabilities. And if you're forced to play a character whose only way of moving through the world is getting people to open up about their vulnerabilities, this forces you into a completely different angle on the world. And I think games are the most freeing when they let us force, when they push us and encourage us to take on different angles. And they're the least freeing when they lock us into a single pervasive value system that we cannot leave and that we're trapped in. A new habit of soul is such a beautiful turn of phrase. And also I feel like the D&D people are like, finally, someone gets. To your philosophy, I understand that a biggie for you all is understanding the meaning of life. So I thought you might enjoy this caller. Hi, this is Jenny. I'm calling from Arizona. I wanted to share the story of my grandfather who did crossword puzzles every day. And I used to sit at the kitchen table while he did crossword puzzles at a very young age and he would ask me questions. And when I got older, I started delving back in and now I do the New York Times Crossword Puzzle Daily, they'll Los Angeles Crossword Puzzle Daily. I love them all. And it just opens your world to so much to learn just what one word can be. And you just keep booking and searching. And that's what life is all about finding the answers. So the secret truth is I've written a book about games and metrics, but it's actually secretly, not that secretly. It's a book about the meaning of life. Because I think games and metrics actually teach you something really intensely about the meaning of life. The philosophy of games influenced me the most, Bernard Suit. At the end of his great book, he has this moment where he says, imagine utopia where we solved all our practical problems. What would we do with our time? We would play games or we would be bored out of our minds. So games must be the meaning of life. What he's saying is actually an idea from Aristotle, what Aristotle thinks is that the meaning of life is in the actions we do, the exercise of our capacities, not our outcomes. And the one, I think one of the things that the Modern World has convinced us of is that the only thing of value are kind of portable outputs. And I think what Suites reminds us of and what Aristotle was pushing was the idea that it's actually the process of inquiry, the figuring of things out, the exercise of your abilities, figuring out how to balance something, figuring out the puzzle. That is actually the thing that makes a human life valuable. I think we all know that in a sense. And yet we've somehow been persuaded that a delightful, beautiful, fascinating, lovely process of doing an interesting puzzle that we should feel ashamed of that or that it's weird to love it because it doesn't result in some kind of portable outcome that you can like sell or process down the line. There you have it, the meaning of life, right here on Science Friday. Dr. C. T. Nguyen is a philosopher at the University of Utah and author of The Score. How to stop playing somebody else's game. T, thank you so much. This has been truly a pleasure. Thank you so much. I didn't realize, but the format that I've always wanted was to riff on people calling in about the games they love. That's the ideal thing that I've always wanted to do in my life. To read an excerpt from T's book, head to our website, sciencewriting.com slash The Score. This episode was produced by Rasha Auready. Thank you all for listening and happy gaming, especially you, Rock and Robbie. I'm Flora Lixman. We'll see you next time.
