Email Print Share

News Release 08-120

Research Publications Online: Too Much of A Good Thing?

New research shows that as more scholarly and research journals are available online, researchers cite fewer, newer papers

A graphic showing a library of leather-bound books through a computer monitor

Researchers have more research papers available, but they are citing fewer of them.


July 17, 2008

View a video interview with sociologist James Evans of the University of Chicago.

This material is available primarily for archival purposes. Telephone numbers or other contact information may be out of date; please see current contact information at media contacts.

The Internet gives scientists and researchers instant access to an astonishing number of academic journals. So what is the impact of having such a wealth of information at their fingertips? The answer, according to new research released today in the journal Science, is surprising--scholars are actually citing fewer papers in their own work, and the papers they do cite tend to be more recent publications. This trend may be limiting the creation of new ideas and theories.

James Evans is an assistant professor of sociology at the University of Chicago, who focuses on the nature of scholarly research. During a lecture on the influence of private industry money on research, a student instead asked how the growth of the Internet has shaped science. "I didn't have an immediate answer," Evans said in an interview last week.

When he reviewed the research on the Internet and science, Evans discovered that most of it focused on much faster and broader the Internet allows scholars to search for information, but not how the medium itself was impacting their work. "That's where this idea came from. I wanted to know how electronic provision changed science, not how much better it made it," he said.

After receiving support from the National Science Foundation to pursue this question, Evans analyzed a database of over 34 million articles and compared their online availability from 1998 to 2005 to the number of times they were cited from1945 to 2005. The results showed that as more journal issues came online, few articles were cited, and the ones that were cited tended to be more recent publications. Scholars also seemed to concentrate their citations more on specific journals and articles. "More is available," Evans said, "but less is sampled, and what is sampled is more recent and located in the most prominent journals."

Evans's research also found that this trend was not evenly distributed across academic disciplines. Scientists and scholars in the life sciences showed the greatest propensity for referencing fewer articles, but the trend is less noticeable in business and legal scholarship. Social scientists and scholars in the humanities are more likely to cite newer works than other disciplines.

So what is it about doing research online versus in a bricks-and-mortar library that changes the literature review so critical to research? Evans has identified a few possible explanations. Studies into how research is conducted show that people browse and peruse material in a library, but they tend to search for articles online Online searches tend to organize results by date and relevance, which leads allows scholars and scientists to pick recent research from the most high profile journals. Some search tools like Google factor the frequency with which other users select an item during similar searchers to determine relevance. Online, researchers are also more likely to follow hyper-linked references and links to similar work within an online archive. Because of this, as more scholars choose to read and reference a given article, future researchers more quickly follow.

Does this phenomenon spell the end of the literature review? Evans doesn't think so, but he does believe that it makes scholars and scientists more likely to come to a consensus and establish a conventional wisdom on a given topic faster. "Online access facilitates a convergence on what science is picked up and built upon in subsequent research." The danger in this, he believes, is that if new productive ideas and theories aren't picked up quickly by the research community, they may fade before their useful impact is evaluated. "It's like new movies. If movies don't get watched the first weekend, they're dropped silently," Evans said.

Evans plans to work with linguists and computer scientists to explore how ideas are expressed in articles to better understand what the consequences of losing old ideas are and how they can be retrieved and resurrected, a challenge he sees as being important in the pursuit of knowledge. "With science and scholarship increasing online, findings and ideas that don't receive attention very soon will be forgotten more quickly than ever before."

-NSF-

Media Contacts
Dana W. Cruikshank, NSF, (703) 292-8070, email: dcruiksh@nsf.gov
William Harms, University of Chicago, 773-702-8356, email: w-harms@uchicago.edu

The U.S. National Science Foundation propels the nation forward by advancing fundamental research in all fields of science and engineering. NSF supports research and people by providing facilities, instruments and funding to support their ingenuity and sustain the U.S. as a global leader in research and innovation. With a fiscal year 2023 budget of $9.5 billion, NSF funds reach all 50 states through grants to nearly 2,000 colleges, universities and institutions. Each year, NSF receives more than 40,000 competitive proposals and makes about 11,000 new awards. Those awards include support for cooperative research with industry, Arctic and Antarctic research and operations, and U.S. participation in international scientific efforts.

mail icon Get News Updates by Email 

Connect with us online
NSF website: nsf.gov
NSF News: nsf.gov/news
For News Media: nsf.gov/news/newsroom
Statistics: nsf.gov/statistics/
Awards database: nsf.gov/awardsearch/

Follow us on social
Twitter: twitter.com/NSF
Facebook: facebook.com/US.NSF
Instagram: instagram.com/nsfgov