text-only page produced automatically by LIFT Text Transcoder Skip all navigation and go to page contentSkip top navigation and go to directorate navigationSkip top navigation and go to page navigation
National Science Foundation
News
design element
News
News From the Field
For the News Media
Special Reports
Research Overviews
NSF-Wide Investments
Speeches & Lectures
NSF Current Newsletter
Multimedia Gallery
News Archive
News by Research Area
Arctic & Antarctic
Astronomy & Space
Biology
Chemistry & Materials
Computing
Earth & Environment
Education
Engineering
Mathematics
Nanoscience
People & Society
Physics
 

Email this pagePrint this page


Press Release 11-027
Measuring Science Investments

Think piece describes new approach to documenting results of scientific research

Image of a ruler.

Memorandum pushes STAR METRICS to gauge the quality and impact of funded research.
Credit and Larger Version

February 10, 2011

Measuring the results of scientific research has seen little federal focus until now.

A 2010 administrative memorandum calls on U.S. federal agencies and executive departments to develop tools to "better assess the impact of [...] science and technology investments."

Translation: There is increasing pressure to document the results of [...] research investments in a scientific manner, writes Julia Lane, Science of Science and Innovation Policy program director at the National Science Foundation (NSF) and her co-author Stefano Bertuzzi, Office of Science Policy at the National Institutes of Health (NIH).

They make the observation in, "Measuring the Results of Science Investments," a Policy Forum paper appearing in this week's edition of the journal Science.

Lane and Bertuzzi examine critical questions for measuring the effects of scientific research. Is it possible to create such a system? What would be the inputs, outputs and structure of the system? What scientific disciplines should inform the formulation of such a model?

"It is important that the scientific community, together with the federal government, engage in describing the results," said Lane of the special burdens placed on measuring the fundamental and exploratory research that NSF is responsible for funding, but does not always show immediate results.

"Fundamental research is a long way from the market place, so there are long lags before any results are seen," she said emphasizing the need to be diligent and sensitive to the exploratory nature of basic research.

The coauthors note other countries already have begun developing systematic ways to describe the results of science investments.

The Higher Education Funding Councils in England has been conducting Research Assessment Exercises to gauge the quality and impact of funded research since 1986.  In addition, last year, the Japanese government began creating a program to advance the science of science and innovation.

In the United States, STAR METRICS attempts to address some of these same challenges. The Science and Technology for America's Reinvestment: Measuring the Effects of Research on Innovation, Competitiveness, and Science program is being developed by NIH and NSF with the backing of the White House Office of Science Technology and Policy.

The Department of Energy and the Environmental Protection Agency are joining the consortium.

"This is a collaborative approach," said Lane. "The goal is to work together with research institutions to build a scientific data infrastructure that gathers inputs, outputs and outcomes from a variety of sources in an open a fashion as possible."

Another major aim of STAR METRICS is to reduce, as much as possible, manual reporting by research institutions and principal investigators.

"Researchers currently spend as much as 42 percent of their time in administrative reporting," said Lane. "That's not a good use of their time."

Lane and Bertuzzi say they hope the active engagement of the federal science policy community through STAR METRICS will help ensure scientific advances in science measurement.

-NSF-

Media Contacts
Bobbie Mixon, NSF, (703) 292-8485, bmixon@nsf.gov

Principal Investigators
Julia I. Lane, NSF, (703) 292-5145, jlane@nsf.gov

The National Science Foundation (NSF) is an independent federal agency that supports fundamental research and education across all fields of science and engineering. In fiscal year (FY) 2014, its budget is $7.2 billion. NSF funds reach all 50 states through grants to nearly 2,000 colleges, universities and other institutions. Each year, NSF receives about 50,000 competitive requests for funding, and makes about 11,500 new funding awards. NSF also awards about $593 million in professional and service contracts yearly.

 Get News Updates by Email 

Useful NSF Web Sites:
NSF Home Page: http://www.nsf.gov
NSF News: http://www.nsf.gov/news/
For the News Media: http://www.nsf.gov/news/newsroom.jsp
Science and Engineering Statistics: http://www.nsf.gov/statistics/
Awards Searches: http://www.nsf.gov/awardsearch/

 

Cover of the February 11, 2011 issue of the journal Science.
The researchers' findings are described in the Feb. 11, 2011 issue of the journal Science.
Credit and Larger Version



Email this pagePrint this page
Back to Top of page