News Release 11-027

Think piece describes new approach to documenting results of scientific research

February 10, 2011

This material is available primarily for archival purposes. Telephone numbers or other contact information may be out of date; please see current contact information at media contacts.

Measuring the results of scientific research has seen little federal focus until now.

A 2010 administrative memorandum calls on U.S. federal agencies and executive departments to develop tools to "better assess the impact of [...] science and technology investments."

Translation: There is increasing pressure to document the results of [...] research investments in a scientific manner, writes Julia Lane, Science of Science and Innovation Policy program director at the National Science Foundation (NSF) and her co-author Stefano Bertuzzi, Office of Science Policy at the National Institutes of Health (NIH).

They make the observation in, "Measuring the Results of Science Investments," a Policy Forum paper appearing in this week's edition of the journal Science.

Lane and Bertuzzi examine critical questions for measuring the effects of scientific research. Is it possible to create such a system? What would be the inputs, outputs and structure of the system? What scientific disciplines should inform the formulation of such a model?

"It is important that the scientific community, together with the federal government, engage in describing the results," said Lane of the special burdens placed on measuring the fundamental and exploratory research that NSF is responsible for funding, but does not always show immediate results.

"Fundamental research is a long way from the market place, so there are long lags before any results are seen," she said emphasizing the need to be diligent and sensitive to the exploratory nature of basic research.

The coauthors note other countries already have begun developing systematic ways to describe the results of science investments.

The Higher Education Funding Councils in England has been conducting Research Assessment Exercises to gauge the quality and impact of funded research since 1986.  In addition, last year, the Japanese government began creating a program to advance the science of science and innovation.

In the United States, STAR METRICS attempts to address some of these same challenges. The Science and Technology for America's Reinvestment: Measuring the Effects of Research on Innovation, Competitiveness, and Science program is being developed by NIH and NSF with the backing of the White House Office of Science Technology and Policy.

The Department of Energy and the Environmental Protection Agency are joining the consortium.

"This is a collaborative approach," said Lane. "The goal is to work together with research institutions to build a scientific data infrastructure that gathers inputs, outputs and outcomes from a variety of sources in an open a fashion as possible."

Another major aim of STAR METRICS is to reduce, as much as possible, manual reporting by research institutions and principal investigators.

"Researchers currently spend as much as 42 percent of their time in administrative reporting," said Lane. "That's not a good use of their time."

Lane and Bertuzzi say they hope the active engagement of the federal science policy community through STAR METRICS will help ensure scientific advances in science measurement.

-NSF-

---

• 
  

  The researchers' findings are described in the Feb. 11, 2011 issue of the journal Science.
  Credit and Larger Version

---

Media Contacts
Bobbie Mixon, NSF, (703) 292-8485, email: bmixon@nsf.gov

Principal Investigators
Julia I. Lane, NSF, (703) 292-5145, email: jlane@nsf.gov

---

The U.S. National Science Foundation propels the nation forward by advancing fundamental research in all fields of science and engineering. NSF supports research and people by providing facilities, instruments and funding to support their ingenuity and sustain the U.S. as a global leader in research and innovation. With a fiscal year 2023 budget of $9.5 billion, NSF funds reach all 50 states through grants to nearly 2,000 colleges, universities and institutions. Each year, NSF receives more than 40,000 competitive proposals and makes about 11,000 new awards. Those awards include support for cooperative research with industry, Arctic and Antarctic research and operations, and U.S. participation in international scientific efforts.

 Get News Updates by Email 

Connect with us online
NSF website: nsf.gov
NSF News: nsf.gov/news
For News Media: nsf.gov/news/newsroom
Statistics: nsf.gov/statistics/
Awards database: nsf.gov/awardsearch/

Follow us on social
Twitter: twitter.com/NSF
Facebook: facebook.com/US.NSF
Instagram: instagram.com/nsfgov