Nature Podcast

AI can turbocharge scientists' careers — but limit their scope

22 min
Jan 14, 20263 months ago
Listen to Episode
Summary

This Nature Podcast episode examines how AI tools are making scientists more productive and successful in their careers, but simultaneously narrowing the scope of scientific inquiry. Researchers analyzed over 41 million papers and found that AI-augmented scientists publish three times more papers and get nearly five times more citations, yet focus on fewer research areas.

Insights
  • AI creates a paradox where individual scientists benefit greatly while science as a whole may suffer from reduced diversity of inquiry
  • Scientists using AI tools are gravitating toward data-rich fields where AI excels, potentially leaving other important areas underexplored
  • The incentive structures in academia may need to change to encourage broader scientific exploration rather than just productivity gains
  • Generative AI tools pose unique challenges for scientific replicability due to their probabilistic nature
  • Early adoption of AI tools in research provides significant career advantages, creating pressure for widespread adoption
Trends
AI-augmented research leading to increased scientific productivity but decreased diversityConcentration of research efforts in data-rich fields amenable to AI analysisGrowing concern about model collapse in science similar to AI training data issuesNeed for new incentive structures to balance individual success with collective scientific progressRising importance of replicability standards for probabilistic AI tools in research
Quotes
"It's a great career move. Scientists who did AI augmented research published about three times as many papers, got nearly five times as many citations, and became research project leaders more than a year earlier than their non AI augmented peers."
James Evans
"If everyone's kind of climbing up the same tree, the low hanging fruits are gone and we're kind of battling over a couple of percentage points as we solve important problems."
James Evans
"I think what we see here is kind of a conflicting incentive for individuals and for science as a whole. Individuals are trying to survive in the scientific universe. They want promotion, they want resources to do more science."
James Evans
"In science we always need to replicate a result. That is a very important thing in science. If you're using a tool that will give you different outputs given the same input, what happens when you go to try and replicate all these studies?"
Vader Story
"We need science to grow. That's its character. And so that means we need to redirect the use of AI."
James Evans
Full Transcript
10 Speakers
Speaker A

This is an ad by BetterHelp.

0:00

Speaker B

Did I talk too much? Can I just let it go? I wish I would stop thinking so much.

0:01

Speaker A

Take a breath. You're not alone. Let's talk about what's going on. Counseling helps you sort through the noise with qualified professionals. And online therapy makes it convenient. See if it's for you. Visit betterhelp.com randompodcast for 10% off your first month of online therapy and let life feel free. Better.

0:10

Speaker C

This is a Monday.com ad. The same Monday.com helping people worldwide, getting work done faster and better. The same Monday.com designed for every team and every industry. The same Monday.com with built in AI scaling your work from day one. The same Monday.com that your team will actually love. Using the same Monday.com with an easy and intuitive setup. Go to Monday.com and try it for free. Yes, the same Monday.com.

0:32

Speaker B

In an experiment we don't know yet.

1:08

Speaker D

Why is like so far like it sounds so simple.

1:10

Speaker C

They had no idea, but now the data split.

1:13

Speaker E

I find this not only refreshing, but.

1:16

Speaker F

At some level, astounding.

1:19

Speaker B

Nature Nature.

1:24

Speaker E

Welcome back to the Nature podcast. This week, how AI might increase researchers productivity but narrow their focus and the.

1:28

Speaker F

Mystery of the universe's little red dots. I'm Benjamin Thompson.

1:37

Speaker E

And I'm Nick Bertra Chow. Artificial intelligence tools are part and parcel of many areas of science. And I don't just mean generative AI assistants like ChatGPT. Deep learning has underpinned tools like AlphaFold, and machine learning has been used to find associations in data for decades. And while a lot can and has been said about the effects of these tools on research, not much is actually known about their impact on science as a whole.

1:41

Speaker G

Well, we were aware of the hype and the associated kind of natural motivation for scientists to use these tools. But we just were wondering if there was a flip side to that. What is that doing to science as a whole?

2:22

Speaker E

This is James Evans, a data scientist who's been looking at this question for a paper that was published in Nature this week. And his results imply that these tools may well make scientists more productive, but at a cost. James and a team of researchers looked at more than 41 million papers published between 1980 to 2025 that were in some way assisted by AI tools, which they refer to as AI augmented research. They also chose to look at the natural sciences, ignoring computer science and mathematics.

2:34

Speaker G

We were interested in how AI is being applied to the sciences, rather than just the core development of AI itself.

3:12

Speaker E

And the natural science research. They were looking at wasn't the only thing that was AI augmented. To read through these 41 million papers, the team used an AI language model called Bidirectional Encoder Representations from Transformers or BERT to its friends. This allowed them to scan through the titles and abstracts to identify possible AI use. This could be things like machine learning or deep learning to scour through data or even generative AI use. The accuracy of this was then scrutinized by human experts and Bert agreed with the experts 87.5% of the time, which.

3:20

Speaker G

Is higher than experts agreed with each other.

4:01

Speaker E

From the initial millions of papers, the team ended up with just over 310,000 that their analysis suggested presented research was AI augmented in some way. They could then look at how many citations these papers got versus the ones that hadn't used any AI tools and how much the scientists behind the AI augmented research went on to publish and how it impacted their careers.

4:04

Speaker G

I mean, it's a great career move. It was a great move at any point when they kind of split from their peers in using AI tools versus comparable scientists that chose not to use those tools at any point of their scientific development. They got more citation attention, they were less likely to drop out of science, and they were more rapidly likely to establish labs and become senior scientists that direct research on paper.

4:28

Speaker E

Scientists who did AI augmented research published about three times as many papers, got nearly five times as many citations, and became research project leaders more than a year earlier than their non AI augmented peers. But James and the team were also interested in the effects of AI on science writ large. So they looked at how these papers related to others. Did they cite one another, for example? And while they found a benefit to individuals, this AI use seemed to be narrowing the focus of science itself.

4:56

Speaker G

So it seemed clear that it was really compressing or kind of automating existing scientific fields rather than generating new questions that that you know, lead to fermentive discussion.

5:32

Speaker E

The analysis suggests that AI augmented researchers were doing more research but in fewer areas, instead focusing on fields that had lots of data and that they could apply their AI tools to a trend which concerned James.

5:45

Speaker G

If everyone's kind of climbing up the same tree, the low hanging fruits are gone and we're kind of battling over a couple of percentage points as we solve important problems. So you know, AI is being used to solve important, established, agreed upon problems and that's important. The problem is if you solve all those problems or if you solve them much faster than you generate new problems, then it slows down the rate of novel questioning and discourse and the kinds of things that unleashes, I would say, human creativity and vision.

6:01

Speaker E

Vader Story, a researcher of computer information systems who's been writing a News and Views article about the new research, was less concerned about these results.

6:33

Speaker H

I thought they were too pessimistic. I would be much more optimistic.

6:42

Speaker E

In some ways, Vader saw these results as a natural conclusion of using AI tools. The tools we have are largely good at working with and sorting through lots of data. So it's unsurprising that people who use them may focus on areas that are data rich. And that's something that she thinks could allow science to advance.

6:46

Speaker H

If you think about it, they have identified the fact that many scientists are using AI tools and if they allow them to go deeper into certain areas, we can benefit from that. We can benefit from an in depth understanding of it. So I just see so many opportunities for us as scientists to continue on this route of using the AI tools. And these AI tools are only going to get better.

7:07

Speaker E

Vader also pointed out that it may be hard to generalize about all of science from the limited study here, especially as it doesn't include some areas like mathematics and computer science. And while the paper did look at generative AI tools, she cautions that it's a bit soon to tell how they might impact science on these tools as well. She was a bit more cautious. She didn't think they were quite ready for use in scientific writing. And she had concerns that they may impact replicability. In the past, AI tools have been deterministic. You put in an input and you get the same output time after time. Generative AI is probabilistic, meaning that you can get different outputs from the same input.

7:36

Speaker H

Now in science we always need to replicate a result. That is a very important thing in science. Can we replicate these studies? Can we ensure that the results that we are reporting are good and hold the test of time for scientific standards? If you're using a tool that will give you different outputs given the same input, what happens when you go to try and replicate all these studies?

8:24

Speaker E

In her opinion, James's study has laid the foundation for further work on this topic and she would like to see how it would play out in a few years time. James, despite his concerns about the narrowing of scientific focus, believes that AI tools have a lot of possibilities for him. We need to instead look at the incentives in science.

8:49

Speaker G

I think what we see here is kind of a conflicting incentive for individuals and for science as a whole. Right. Individuals are trying to survive in the scientific universe. They want promotion, they want resources to do more science. And what's the fastest, most efficient way to do that, especially with AI tools that effectively compress data that you have and produce answers and predictions. But I think science as a whole has a different incentive, which is to kind of know everything.

9:11

Speaker E

James would like to see more incentives to forge new fields and ask new questions. He even thinks AI could assist with that by collecting data from more data sparse fields. That too would need incentives. Without change, James predicts that people will just carry on using AI. How they have potentially shrinking the focus of scientific inquiry. So to allow science to grow, James thinks we need to change how we use AI.

9:44

Speaker G

AI use is vast and it's growing and it's accelerating in science. And there are some massive missed opportunities in how we use it to expand the space of collective inquiry to new fields and the generation of new data. And that if we don't do that, then we risk the kind of model collapse that we see when AI models basically consume the results of their own data. You know, they pull in the tails of the distribution and they just stop working. Like we need science to grow. That's its character. And so that means we need to redirect the use of AI.

10:14

Speaker E

That was James Evans from the University of Chicago in the U.S. you also heard from Vader Story from Georgia State University, also in the US for more on that, check out the show notes for some links.

10:53

Speaker F

Coming up, the research that may have solved the riddle of the universe's little red dots. Right now, though, it's time for the research highlights read by Catriona Clark.

11:04

Speaker D

Snowball Earth's oceans were not only very cold, but also extremely salty, According to analysis of rocks from the time around 700 million years ago. It's been proposed that the Earth resembled a snowball, with glaciers reaching all the way to the equator and average temperatures potentially 12 degrees Celsius below freezing. To put it mildly, it would have been pretty chilly. And this covering of the oceans with ice would cut off the usual exchanges between land and sea. For example, iron that would usually have been oxidised by photosynthetic organisms would have ended up deposited on the ocean floor. Researchers analyzed such deposits in rocks dating from the snowball Earth period. By modeling how different isotopes of iron would have been separated in water, they concluded that the iron was deposited in temperatures between moving -22 and -8 degrees Celsius. At these temperatures, to stay liquid, the water would have had to have been extremely salty. These frigid times may actually have been Earth's coldest ocean temperatures. Chill out and give that study a read over Nature Communications. Putting immune cells into night mode may reduce the damage from heart attacks Neutrophils are a type of immune cell that protect against microorganisms, but they can also kill surrounding tissue, which can increase the damage from heart attacks. It's been known that neutrophils are more active in the early morning than at night, so researchers tried to see what would happen if they put them into the less active night mode in mice. The mice were given a drug that targeted one of the neutrophil's receptors that control daily fluctuations in activity. The team found that the treated neutrophils displayed nighttime like behaviour and the mice given the drug had less dead or damaged heart tissue. This treatment didn't seem to affect immunity as the mice responded normally when treated with Staphylococcus aureus bacteria or Candida albicans fungi, suggesting that this night mode for neutrophils could be a promising approach to treat heart attacks in people. Don't switch off from that research. It's over. In Journal of Experimental Medicine.

11:18

Speaker F

An astronomical puzzle may be a step closer to being solved, thanks to research published in Nature this week. Now, if you look at an image taken by the James Webb Space Telescope, the jwst, it's hard not to be wowed by spectacular images of distant stars and gal. But if you look closer, you might notice something that has left researchers scratching their heads. Often these images are peppered with tiny points of light known as little red dots. The light from these dots has traveled a really long way to get to us, meaning these objects are likely really old. Some estimates have them down as being present in the early universe, around 600 million years after the Big Bang. And these little red dots have been dubbed universe breakers because they don't fit in with standard thinking about the features of the early universe. There's been a lot of debate about whether these dots are young star filled galaxies or outsized black holes. Well, according to a team of researchers, the answer could be neither. To find out what they think it is, I spoke to one of the team, Vadim Rusakov, who is affiliated with the University of Manchester here in the uk. Vadim explained to me why neither of the initial theories about the little red dots quite worked.

13:49

Speaker B

So when people counted the number of stars in those red dots, they found that there's just too many stars to be produced at that point in the universe. They were universe breakers just because it's hard to explain how you can form so many stars in such a small volume so early on. So there had to be something else that was contributing to that light coming from those dots. When we looked in more detail. So when we gathered more information and more data about these little red dots, we found that they exhibit features of supermassive black holes. And those particular features are of a gas rotating quickly around a supermassive black hole. And because supermassive black holes produce a lot of light, so the gas gets accreted, it gets really heat and produces a lot of light. Sometimes they shine just as bright as a whole galaxy. And so, because you have these dots made up probably partly from stars and partly from the supermassive black holes, now, that universe breaker problem in the stellar context kind of goes away. But there were a couple of issues that we still had to resolve in order to tell that they are galaxies containing supermassive black holes.

15:12

Speaker F

So there was this discrepancy then as to what they might be. But there was one theory that was perhaps a front runner, and this was the. The unusual situation of there being supermassive black holes enveloped in a layer of gas. And there was some evidence to back that up. And your work comes to a similar conclusion and perhaps helps to solve one of the puzzles surrounding the idea that at the heart of these little red dots was a regular supermassive black hole. And to get to this conclusion, you looked at a dozen of these little red dots for which there's been a lot of data collected. And particularly you were looking at the light emitted by these objects. What can that tell you?

16:15

Speaker B

So, yes, we can tell how massive the black holes are just from the rotation of the gas around the supermassive black holes and the light that it kicks out. There's a really broad feature in the spectrum that tells us that there has to be gas moving at thousands of kilometers per second. So people found this feature, but the problem with that was that you can use it to measure the mass of the black hole. But if you use it to measure the mass of black hole, it turns out to be quite massive. Again, we're coming back to the same problem of universe breakers, not with the stars, but with the black holes. Because they are found so early in the universe, it was a bit problematic that they were so massive at that point in the universe. So the black holes had to have formed really quickly and have accreted a lot of material in order to have grown so much.

16:53

Speaker F

So what you're saying is then. Yeah, that something this Old couldn't get that big that quickly then. But the data suggested that that's what was going on.

17:36

Speaker B

Right? So what we found in our work is that it was not the problem with the black holes themselves, but it was the problem with how we interpreted the data. So the same observation that tells us the gas has to be rotating really quickly could actually be produced by a very different system where the gas around the black hole has to be just very dense. It doesn't have to be rotating as quickly. And what is special about this system compared to a normal supermassive black hole that we can find in the local universe or elsewhere, is that it doesn't have to be just a neutral gas. It has to be an ionized gas. So there have to be essentially a sea of electrons, a cocoon of electrons, surrounding these black holes. So in our model, the light gets scattered off the free electrons in that cocoon. That scattering actually produces the features that people thought before were telling us about. The gas is quickly rotating around the black holes because the gas doesn't rotate as quickly. The black holes that people thought were massive are actually not as massive and sometimes 10 to 100 times less massive, which helps us ease a lot of these universe breaker type of problem.

17:41

Speaker F

And this thick cloud of gas helps to explain some of the other features that weren't seen, because usually black holes kick out all sorts of different wavelengths of electromagnetic radiation which aren't seen in the little red dots. And maybe this cocoon is helping that.

18:39

Speaker B

Yes, exactly. There are different pieces to this puzzle. So normally if you see a black hole, you'd expect there to be all kinds of emission produced particles, from X rays to radio waves. Then you also see all kinds of light variation can happen. So light sort of twinkles a little bit when you look at these systems over time, but we don't see any of those. And so the puzzle actually can be solved with this cocoon idea. Those X rays, those radio waves that we do not detect, can be partly killed off by this shell of electrons. Essentially, if it's also a thick cocoon of gas, that could help to explain the fact that these black holes do not twinkle. It's still not established, but it can happen that because there's a thick cloud of gas that the light has to travel through, it takes a somewhat longer time, which means that these black holes can vary in light. They can twinkle, but on a longer time scale, and we just haven't observed them on that long enough timescale.

18:56

Speaker F

And so your results then suggest that what you've got here is a relatively small supermassive black hole, if I can put it like that, surrounded by this thick cocoon then of gas and electrons and what have you. Does this suggest that this is how enormous black holes might develop over time? As these distant little red dots are.

19:51

Speaker B

So ancient, so we expect some of them to grow to the supermassive black holes that we find in the local universe. So some of them will probably get to very massive black holes. Some of them will probably stop growing just because they ran out of fuel. And we think that we find them in this early stage where it's a stage of very rapid growth that we haven't seen before, actually. So we haven't seen such objects in the local universe. We're only now starting to find actually things that are analogous to these little red dots, but much closer, very low numbers.

20:10

Speaker F

Obviously, your paper is out now and you put forward your evidence that these little red dots are relatively small supermassive black holes surrounded by gas. Of course there are competing theories about what these things are. Do you think your work puts this to bed? What do you think other people will make of these results?

20:36

Speaker B

So there are different groups working independently from each other, coming to very similar conclusions with similar models as we do. So there's at least two or three, probably including ourselves. So I think it helps to have some sort of consensus in the community that these black holes have to be cocooned in a thick shell of gas, which is what makes these black holes unique, unlike the black holes we've seen previously. But there might be some things that we're still trying to figure out in terms of physical details as to how much there is ionized gas and so on. So we're trying to figure out the details.

20:55

Speaker F

And so everyone loves a space mystery. I mean, it seems like we're discovering new stuff, stuff all the time. I mean, are you happy that you think you've solved the mystery of the little red dot, or are you almost sad that now we know what they are and the mystery has gone somewhat.

21:24

Speaker B

I'm very happy. Of course, it's been a whole journey. So I've learned a lot on the way and I've met a lot of people. So it's been very delightful to be part of this. I think we're sort of pushed the boundary of what is known and what is unknown further. So this opens up all kinds of questions now that we can attack, like, how does it matter black holes form, we're finding them in their youth, but can we understand how they actually formed.

21:36

Speaker F

Vadim Rusakov there to read his paper. Head over to the Show Notes for a link.

21:57

Speaker E

That's it for this week's show, but before we go, a little announcement.

22:02

Speaker F

Yeah, absolutely right, Nick. It's a new year and we're going to be changing things up a little bit here at the Nature Podcast. Now, at this point in the show, we'd usually be doing the briefing chat, but starting this week we're going to be spinning that segment out into its own podcast, which will be in your feeds on Fridays.

22:05

Speaker E

So you'll still be getting the latest science news on a Wednesday and a.

22:23

Speaker F

Quick research roundup on a Friday. We'll see you then. I'm Benjamin Thompson.

22:27

Speaker E

And I'm Nick Pertridge Howe. Thanks for listening.

22:31

Speaker I

If you're the purchasing manager at a manufacturing plant, you know having a trusted partner makes all the difference. That's why, hands down, you count on Grainger for auto reordering. With on time restocks, your team will have the cut resistant gloves they need at the start of their shift and you can end your day knowing they've got safety well in hand. Call 1-800-GRAINGER Click grainger.com or just stop by Grainger for the ones who get it done.

22:45

Speaker J

Why Choose a Sleep Number Smart Bed.

23:14

Speaker C

Can I make my site softer?

23:16

Speaker I

Can I make my site firmer? Can we sleep cooler?

23:18

Speaker J

Sleep number does that cools up to 8 times faster faster and lets you choose your ideal comfort on either side. Your sleep number setting J.D. power ranks sleep number number one in customer satisfaction with mattresses purchased in store and online. And now the more you buy, the more you save on beds, bases and more. Plus, get free premium delivery on any bed with bass limited time. For J.D. power 2025 award information, visit J.D. power.com awards check it out at the Sleep Numbers store today.

23:21