Section A. Technical Notes
Scope and Method
During the period February through August 1998, a total of 32 Federal agencies
and their subdivisions-93 individual respondents-submitted data in response
to the National Science Foundation's (NSF's) annual Survey
of Federal Funds for Research and Development (Federal funds survey), which
was distributed in February 1998. The agencies reported their data as obligations
and outlays incurred, or expected to be incurred, regardless of when the funds
were appropriated or whether they were identified in the respondents' budgets
specifically for research and development (R&D) activities.
Only those agencies that had obligations in the variables represented by a
particular table appear in that table. For a complete list of the Federal agencies
that have been included in the Federal funds survey, refer to appendix
. For additional notes associated with these agencies, refer to appendix
The definitions are essentially unchanged from those used in past Federal funds surveys.
A performer is either an intramural group or organization carrying out an operational function or an extramural organization or person receiving support or providing services under a contract or grant.
- An agency is an organization of the Federal Government whose principal executive officer reports to the President. The Library of Congress is also included in the survey, even though its chief officer reports to Congress.
Subdivision refers to any organizational unit of a reporting agency, such as a bureau, division, office, or service.
- Obligations and outlays reported are consistent with figures
shown for fiscal years 1997, 1998, and 1999 appearing in The
Budget of the United States Government, Fiscal Year 1999. The R&D
data in both agency submissions were based on the same definitions and are
Obligations represent the amounts for orders placed, contracts awarded, services received, and similar transactions during a given period, regardless of when the funds were appropriated and when future payment of money is required.
Outlays represent the amounts for checks issued and cash payments made during a given period, regardless of when the funds were appropriated.
Obligations and outlays cover all transactions that occurred in fiscal year 1997 and those estimated for fiscal years 1998 and 1999.
The data include all Federal funds available to an agency that the agency received or expects to receive from direct appropriations, trust funds, special account receipts, corporate income, or other sources, including funds appropriated to the
The amounts shown for each year reflect obligations or outlays for that year regardless of when the funds were originally authorized or received and regardless of whether or not they were appropriated, received, or identified in the agency's budget
specifically for research, development, or R&D plant.
In reporting its obligations or outlays, each agency includes the amounts transferred to other agencies for support of research and development. The receiving agencies do not report funds transferred to them. Similarly, a
subdivision of an agency that transfers funds to another subdivision within that agency reports such obligations or outlays as its own.
Obligations and outlays for R&D performed for an agency in foreign countries include all funds available to the agency for this purpose, including funds separately appropriated for special foreign currency programs.
Funds reported for research and development reflect full cost coverage. In addition to costs of specific R&D projects, the applicable overhead costs are also included. The amounts reported include the costs of planning and
administering R&D programs, laboratory overhead, pay of military personnel, and departmental administration.
- The fiscal year in the Federal Government accounting period begins October 1 of a given year and ends September 30 of the following year; thus, fiscal year 1997 began on October 1, 1996, and ended September 30, 1997.
- Research, development, and R&D plant include all direct, incidental, or related costs resulting from, or necessary to, performance of R&D and costs of R&D plant, defined as follows, regardless of whether the R&D is performed by a
Federal agency (intramurally) or by private individuals and organizations under grant or contract (extramurally). R&D excludes routine product testing, quality control, mapping and surveys, collection of general purpose statistics, experimental
production, and the training of scientific personnel.
- Research is systematic study directed toward fuller scientific knowledge or understanding of the subject studied. Research is classified as either basic or applied according to the objectives of the sponsoring agency.
In basic research the objective of the sponsoring agency is to gain more complete knowledge or understanding of the fundamental aspects of phenomena and of observable facts, without specific applications toward processes or products
In applied research the objective of the sponsoring agency is to gain knowledge or understanding necessary for determining the means by which a recognized need may be met.
- Development is systematic use of the knowledge or understanding gained from research, directed toward the production of useful materials, devices, systems, or methods, including design and development of prototypes and processes.
It excludes quality control, routine product testing, and production.
To better differentiate between that part of the Federal R&D budget which supports "science and key enabling technologies" (including for military and nondefense applications) and that which primarily concerns "testing and evaluation" (of mostly
defense-related systems), NSF now collects from DoD development dollars in two categories, advanced technology development and major systems development.
Within DoD's research categories, advanced technology development is classified as 6.3A. Major systems development is classified as 6.3B through 6.7 and includes demonstration and validation, engineering and manufacturing development, management
and support, and operational system development.
- Demonstration activities that are part of R&D (i.e., that are intended to prove or to test whether a technology or method does in fact work) are included. Demonstrations intended primarily to make information available about new
technologies or methods are excluded.
- R&D plant (R&D facilities and fixed equipment, such as reactors, wind tunnels, and particle accelerators) includes acquisition of, construction of, major repairs to, or alterations in structures, works, equipment, facilities, or
land for use in R&D activities at Federal or non-Federal installations. Excluded from the R&D plant category are expendable or movable equipment (e.g., spectrometers, microscopes) and office furniture and equipment. Also excluded are the costs of
predesign studies (e.g., those undertaken before commitment to a specific facility). These excluded costs are reported under "total conduct of research and development." Obligations for foreign R&D plant are limited to Federal funds for facilities
that are located abroad and used in support of foreign research and development.
- Fields of science and engineering in this survey consist of eight broad field categories, each consisting of a number of detailed fields. The broad fields are life sciences; psychology; physical sciences; environmental sciences;
mathematics and computer sciences; engineering; social sciences; and other sciences, not elsewhere classified. The term "not elsewhere classified" (n.e.c.) is used for multidisciplinary projects within a broad field and for single-discipline
projects for which a separate field has not been assigned. The following list presents the detailed fields grouped under each of the broad fields, together with illustrative disciplines of detailed fields.
The illustrative disciplines are intended to be guidelines, not sharp definitions; they represent examples of disciplines generally classified under each detailed field. A discipline under one detailed field may be classified under another detailed
field when the major emphasis is elsewhere. Research in biochemistry, for example, might be reported as biological, agricultural, or medical, depending on the orientation of the project. Human biochemistry would be classified under biological, but
animal biochemistry or plant biochemistry would fall under agricultural. In no case is the research reported under more than one field. No double-counting is intended or allowed.
- Life sciences consist of five detailed fields: biological (excluding environmental); environmental biology; agricultural; medical; and life sciences, n.e.c. Examples of the disciplines under each of these fields are as follows:
Biological (excluding environmental): anatomy; biochemistry; biology; biometry and biostatistics; biophysics; botany; cell biology; entomology and parasitology; genetics; microbiology; neuroscience (biological); nutrition;
physiology; zoology; other biological, n.e.c.
Environmental biology: ecosystem sciences; evolutionary biology; limnology; physiological ecology; population and biotic community ecology; population biology; systematics; other environmental biology, n.e.c.
Agricultural: agronomy; animal sciences; food science and technology; fish and wildlife; forestry; horticulture; phytopathology; phytoproduction; plant sciences; soils and soil science; general agriculture; other agriculture, n.e.c.
Medical: dentistry; internal medicine; neurology; obstetrics and gynecology; ophthalmology; otolaryngology; pathology; pediatrics; pharmacology; pharmacy; preventive medicine; psychiatry; radiology; surgery; veterinary medicine;
other medical, n.e.c.
Life sciences, n.e.c.
- Psychology deals with behavior, mental processes, and individual and group characteristics and abilities. Psychology in this survey is divided into three categories: biological aspects; social aspects; and psychological
sciences, n.e.c. Examples of the disciplines under each of these fields are as follows:
Biological aspects: animal behavior; clinical psychology; comparative psychology; ethology; experimental psychology
Social aspects: development and personality; educational, personnel, and vocational psychology and testing; industrial and engineering psychology; social psychology
Psychological sciences, n.e.c.
- Physical sciences are concerned with understanding of the material universe and its phenomena. They comprise the fields of astronomy; chemistry; physics; and physical sciences, n.e.c. Examples of disciplines under each of these
fields are as follows:
Astronomy: laboratory astrophysics; optical astronomy; radio astronomy; theoretical astrophysics; X-ray, gamma-ray, and neutrino astronomy
Chemistry: inorganic; organic; organometallic; physical
Physics: acoustics; atomic and molecular; condensed matter; elementary particle; nuclear structure; optics; plasma
Physical sciences, n.e.c.
- Environmental sciences (terrestrial and extraterrestrial) are, with one exception, concerned with the gross nonbiological properties of the areas of the solar system that directly or indirectly affect human survival and welfare.
The one exception is that obligations for studies pertaining to life in the sea or other bodies of water are reported as support of oceanography and not biology. Environmental sciences comprise the fields of atmospheric sciences; geological
sciences; oceanography; and environmental sciences, n.e.c. Examples of disciplines under each of these fields are as follows:
Atmospheric sciences: aeronomy; extraterrestrial atmospheres; meteorology; solar; weather modification
Geological sciences: engineering geophysics; general geology; geodesy and gravity; geomagnetism; hydrology; inorganic geochemistry; isotopic geochemistry; laboratory geophysics; organic geochemistry; paleomagnetism; paleontology;
physical geography and cartography; seismology; soil sciences
Oceanography: biological oceanography; chemical oceanography; marine geophysics; physical oceanography
Environmental sciences, n.e.c.
- Mathematics and computer sciences employ logical reasoning with the aid of symbols and are concerned with the development of methods of operation employing such symbols and, in the case of computer sciences, with the application
of such methods to automated information systems. Examples of disciplines under these fields are as follows:
Mathematics: algebra; analysis; applied mathematics; foundations and logic; geometry; numerical analysis; statistics; topology
Computer sciences: computer and information sciences (general); design, development, and application of computer capabilities to data storage and manipulation; information sciences and systems; programming languages; systems
Mathematics and computer sciences, n.e.c.
- Engineering is concerned with studies directed toward developing engineering principles or toward making specific principles usable in engineering practice. Engineering in this survey is divided into eight fields: aeronautical;
astronautical; chemical; civil; electrical; mechanical; metallurgy and materials; and engineering, n.e.c. Examples of disciplines under each of these fields are as follows:
Astronautical: aerospace; space technology
Chemical: petroleum; petroleum refining; process
Civil: architectural; hydraulic; hydrologic; marine; sanitary and environmental; structural; transportation
Electrical: communication; electronic; power
Mechanical: engineering mechanics
Metallurgy and materials: ceramic; mining; textile; welding
Engineering, n.e.c.: agricultural; bioengineering; biomedical; industrial and management; nuclear; ocean; systems
- Social sciences are directed toward an understanding of the behavior of social institutions and groups and of individuals as members of a group. Social sciences include anthropology; economics; political science; sociology; and
social sciences, n.e.c. Examples of disciplines under the fields of social science are as follows:
Anthropology: applied anthropology; archaeology; cultural and personality; social and ethnology
Economics: economic systems and development; econometrics and economic statistics; history of economic thought; industrial, labor, and agricultural economics; international economics; macroeconomics; microeconomics; public finance
and fiscal policy; theory
Political science: area or regional studies; comparative government; history of political ideas; international relations and law; national political and legal systems; political theory; public administration
Sociology: comparative and historical; complex organizations; culture and social structure; demography; group interactions; social problems and social welfare; sociological theory
Social sciences, n.e.c.: linguistics; research in education; research in history; research in law (e.g., attempts to assess impact on society of legal systems and practices); socioeconomic geography
- Other sciences, n.e.c.: This category is used for multidisciplinary or inter-disciplinary projects that cannot be classified within one of the broad fields of science already listed.
Federal obligations for research performed at universities and colleges,
by detailed field of science: Only six agencies participate in the
portion of the survey covering the funding of research at universities and
colleges by detailed field of science. These six agencies represent approximately
97 percent of the Federal research obligations to universities and colleges.
The six agencies are the Departments of Agriculture,
and Health and Human Services; the National
Aeronautics and Space Administration (NASA); and the National
Science Foundation (NSF).
- Intramural performers are the agencies of the Federal Government. Their work is carried on directly by agency personnel. Obligations reported under this category are for activities performed or to be performed by the reporting
agency itself or represent funds that the agency transfers to another Federal agency for performance of work as long as the ultimate performer is that agency or any Federal agency. If the ultimate performer is not a Federal agency,
the funds so transferred are reported by the transferring agency under the appropriate extramural performer category (universities and colleges, other nonprofit institutions, or industrial firms).
NOTE: Intramural activities cover not only the actual intramural R&D performance, but also the costs associated with the planning and administration of both intramural and extramural programs by Federal personnel. Intramural activities also
include the costs of supplies and equipment, essentially of an "off-the-shelf" nature, that are procured for use in intramural R&D. For example, the purchase from an extramural source of an operational launch vehicle (i.e., one that has gone beyond
the development or prototype stage) that is used for intra-mural performance of R&D is reported as a part of the cost of intramural R&D.
- Extramural performers are organi-zations outside the Federal sector that perform R&D with Federal funds under contract, grant, or cooperative agreement. Only those costs associated with actual R&D performance are reported, but
these costs would include costs of materials and supplies to carry out R&D activities. Note, however, that the costs of off-the-shelf supplies and equipment required to support intramural R&D and procured from extramural suppliers are considered as
part of the costs of intramural performance and not as part of the costs of extramural performance.
Extramural performers are identified as follows:
- Industrial firms: Organizations that may legally distribute net earnings to individuals or to other organizations.
- Universities and colleges: Institutions engaged primarily in providing resident and/or accredited instruction for at least a 1-year program above the secondary school level. Included are colleges of liberal arts; schools of
arts and sciences; professional schools, as in engineering and medicine, including affiliated hospitals and associated research institutes; and agricultural experiment stations.
- Other nonprofit institutions: Private organizations other than educational institutions whose net earnings in no part inure to the benefit of a private stockholder or individual and other private organizations organized for the
exclusive purpose of turning over their entire net earnings to such nonprofit organizations.
- Federally funded research and development centers (FFRDCs): R&D-performing organizations that are exclusively or substantially financed by the Federal Government and are supported by the Federal Government either to meet a
particular R&D objective or, in some instances, to provide major facilities at universities for research and associated training purposes. Each center is administered either by an industrial firm, a university, or another nonprofit institution.
In general, all of the following criteria are met by an organization that is included in the FFRDC category:
(1) Its primary activities include one or more of the following: basic research, applied research, development, or management of research and development (specifically excluded are organizations engaged primarily in routine quality control and
testing, routine service activities, production, mapping and surveys, and information dissemination);
(2) It is a separate operational unit within the parent organization or is organized as a separately incorporated organization;
(3) It performs actual research and development or R&D management either upon direct request by the Federal Government or under a broad charter from the Federal Government but in either case under the direct monitorship of the Federal Government;
(4) It receives its major financial support (70 percent or more) from the Federal Government, usually from one agency;
(5) It has, or is expected to have, a long-term relationship with its sponsoring agency (about 5 years or more), as evidenced by specific obligations assumed by it and the agency;
(6) Most or all of its facilities are owned by, or are funded under contract with, the Federal Government; and
(7) It has an average annual budget (operating and capital equipment) of at least $500,000.
- State and local governments: State and local government
agencies, excluding State or local universities and colleges, agricultural
experiment stations, medical schools, and affiliated hospitals. (Federal
R&D funds obligated directly to such State and local institutions
excluded in this category are included under the "Universities
and colleges" category in this report.) R&D activities under the
State and local category are performed either by the State or local
agencies themselves or by other organizations under grants or contracts
from such agencies. Regardless of the ultimate performer, Federal
R&D funds directed to State and local governments are reported under
this sector and no other.
- Foreign performers: Foreign citizens, foreign organizations,
or foreign governments, as well as international organizations (such
as the North Atlantic Treaty Organization
(NATO), United Nations Educational,
Scientific, and Cultural Organization (UNESCO), and World
Health Organization (WHO)), performing R&D work abroad financed
by the Federal Government. Excluded are U.S. agencies, organizations,
or citizens performing R&D abroad for the Federal Government; the
survey does not seek information on "offshore" payments. An exception
is made in the case of U.S. citizens performing R&D abroad under special
foreign currency funds; these activities are included under "Foreign
performers." Foreign scientists performing in the United States are
- Private individuals: For cases wherein an R&D grant or contract is awarded directly to a private individual, obligations incurred are placed under "Industrial firms."
Geographic distribution of 1997 R&D obligations
- Only the 10 largest R&D funding agencies participate in the portion
of the survey covering the geographic distribution of obligations for
research and development and R&D plant. These 10 agencies accounted for
approximately 98 percent of total Federal R&D and R&D plant obligations
in 1997. The respondents are the Departments
of Agriculture, Commerce, Energy,
and Human Services, the Interior,
and Transportation; the Environmental
Protection Agency; NASA; and NSF.
- Actual fiscal year 1997 data were requested in terms of the principal location (State or outlying area) where the work was performed by the primary contractor, grantee, or intramural organization. When this information was not available in their
records, the respondents were asked to assign the obligations to the State, outlying area, or office abroad where the headquarters of the U.S. primary contractor, grantee, or intramural organization was located.
- Obligations were reported for R&D as a combined amount.
- Specifically omitted from the geographic portion of the survey were R&D obligations to foreign performers and support of foreign performers. Foreign performer data, by country, are reported in a separate section of the Federal funds survey.
Changes in Reporting
While completing the survey forms each year, agency respondents make revisions to their estimates for the latest 2 years of the previous report, in this case fiscal years 1997 and 1998. Such revision is part of the budgetary cycle. From time to
time survey submissions also reflect reappraisals and revisions in classification of various aspects of agencies' R&D programs. When such revisions occur, NSF requires the agencies to provide revised prior-year data to maintain consistency and
comparability with the most recent concepts.
Changes in the Scope of the Survey
The scope of the Federal funds survey has changed over time, and the survey instrument has been revised accordingly. The most recent changes are described in the following paragraphs.
Since the Volume 40 (FYs 1990--92) survey cycle, the Department of Defense
(DoD) has reported research obligations separate from the development obligations
for Table A, Obligations for research and development, by State and performer.
(Tables A1, Obligations for research, by State and performer, and A2,
Obligations for development, by State and performer, were created for
DoD to complete in place of Table A.) The additional detail provided by DoD
highlights the following circumstances that are specific to DoD:
- DoD funds the preponderance of Federal development.
- DoD development funded at institutions of higher education is typically performed at university-affiliated non-academic laboratories that are separate from the universities' academic departments where university research is typically
- Geographic distribution of development funding to industry reflects only the location of prime contractors, not the numerous subcontractors who perform most of the research and development.
During the Volume 44 (FYs 1994--96)
survey cycle, the Director for Defense Research and Engineering (DDR&E) at DoD
requested that NSF further clarify the true character of DoD's R&D program,
particularly as it compares with other Federal agencies, by adding more detail
to development obligations reported by DoD respondents. Specifically, DoD requested
that NSF allow DoD agencies to report development obligations in two separate
categories, advanced technology development and major systems development.
The reasoning behind DDR&E's request for the additional development categories is best explained by the following excerpt from a letter written by Robert V. Tuohy, Chief, Program Analysis and Integration at DDR&E, to John E. Jankowski, Jr.,
Program Director, Research and Development Statistics Program, SRS:
The DoD's R&D program is divided into two major pieces, Science and Technology (S&T) and Major Systems Development. The other Federal agencies' entire R&D programs are equivalent in nature to DoD's S&T program, with the exception of the Department of
Energy and possibly NASA. Comparing those other agency programs to DoD's program, including the development of weapons systems such as F-22 Fighter and the New Attack Submarine, is misleading.
At several annual issues workshops held during FYs 1992--96, NSF learned from
survey respondents that there were certain Federal funds survey data items for
which reliable data were difficult to obtain and report. As a result, NSF began
to consider removing certain items from the Federal funds survey instrument.
The Volume 42 Detailed Statistical
Tables publication was distributed with a flier notifying data users that NSF
was considering eliminating several items from future volumes of the document.
Data users were asked to review the list of affected tables shown on the flier,
and to comment on the proposed eliminations to NSF.
Prior to the publication of the Volume
43 (FYs 1993--95) edition of the Detailed Statistical Tables, NSF decided
to remove 54 tables from the document that depicted data on two of the items
slated for elimination: data for the special foreign currency program, and detailed
field of S&E data for estimated outyears. NSF continued to collect data from
Federal agencies for these items through Volume
45, but eliminated the special foreign currency program and outyears' detailed
field of S&E lines on the survey instrument beginning with the Volume
46 (FYs 1996--98) survey cycle. A special flier was included in the Volume
46 mailout packet that listed the data items that were no longer required.
NSF also decided to remove two tables depicting data on foreign performers
by region, country, and agency prior to publication of the Volume
43 edition of the Detailed Statistical Tables. These tables have been reinstated
since Volume 46.
Limitations of the Data
Funds for research and development were reported on a 3-year basis comparable with the 1999 budget, upon which the data were based. The amounts reported for each year, as already stated, are the obligations or outlays incurred in that year,
regardless of when funds were authorized or received by an agency and regardless of whether the funds were identified in the agency's budget specifically for research, development, R&D plant, or some combination of the three.
The respondents reconciled the data reported to the Federal funds survey with the amounts for R&D they reported to the Office of Management and Budget for the 1999 President's budget.
Some agencies are not able to report the full costs of research and development. For example, the headquarters costs of planning and administering R&D programs of the Department of Defense (DoD) (estimated at a fraction of 1 percent of the
agency's R&D total) are excluded, because this agency has stated that identification of the amounts is impracticable.
R&D plant data are also underreported to some extent because of the difficulty encountered by some agencies, particularly DoD and NASA, in identifying and reporting these data. DoD's respondents report obligations for the R&D plant funded under
the agency's construction appropriation, but they are able to identify only a small portion of the R&D plant support that is within R&D contracts funded from DoD's appropriation for research, development, testing, and evaluation. Similarly, NASA
respondents cannot separately identify the portions of industrial R&D contracts that apply to R&D plant; R&D plant data are subsumed in the R&D data covering industrial performance. NASA R&D plant data for other performing sectors are reported