Award Abstract # 1540931
Stampede 2: The Next Generation of Petascale Computing for Science and Engineering

NSF Org: OAC
Office of Advanced Cyberinfrastructure (OAC)
Awardee: UNIVERSITY OF TEXAS AT AUSTIN
Initial Amendment Date: May 31, 2016
Latest Amendment Date: June 11, 2020
Award Number: 1540931
Award Instrument: Cooperative Agreement
Program Manager: Robert Chadduck
rchadduc@nsf.gov
 (703)292-2247
OAC
 Office of Advanced Cyberinfrastructure (OAC)
CSE
 Direct For Computer & Info Scie & Enginr
Start Date: June 1, 2016
End Date: May 31, 2021 (Estimated)
Total Intended Award Amount: $30,000,000.00
Total Awarded Amount to Date: $30,000,000.00
Funds Obligated to Date: FY 2016 = $30,000,000.00
History of Investigator:
  • Daniel Stanzione (Principal Investigator)
    dan@tacc.utexas.edu
  • Tommy Minyard (Co-Principal Investigator)
  • Paul Navratil (Co-Principal Investigator)
  • William Barth (Co-Principal Investigator)
  • Niall Gaffney (Co-Principal Investigator)
  • Kelly Gaither (Former Co-Principal Investigator)
Awardee Sponsored Research Office: University of Texas at Austin
110 INNER CAMPUS DR
AUSTIN
TX  US  78712-1139
(512)471-6424
Sponsor Congressional District: 25
Primary Place of Performance: University of Texas at Austin
101 E 27th Street, Suite 5.300
Austin
TX  US  78712-1531
Primary Place of Performance
Congressional District:
25
Unique Entity Identifier (UEI): V6AFQPN18437
Parent UEI: X5NKD2NFF2V3
NSF Program(s): Innovative HPC
Primary Program Source: 040100 NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s):
Program Element Code(s): 7619
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

The Texas Advanced Computing Center (TACC) at the University of Texas at Austin will acquire and deploy Stampede 2, a new, nearly 20 petaflop High Performance Computing (HPC) system. This system will be available to and accessed by thousands of researchers across the country. It will enable new computational and data-driven scientific and engineering, research and educational discoveries and advances. As a national resource, Stampede 2 will replace and surpass the current highly successful Stampede system. The new system will deliver over twice the overall performance as the current system in many dimensions most important to scientific computing, including computing capability, storage capacity, and network bandwidth. TACC and its academic partners will team with Dell, Inc. and Intel Corp. to procure and provide this system.

HPC is intrinsic to discovery across the science and engineering disciplines served by the NSF. This resource allows researchers to explore those scientific and engineer frontiers that require very large scale computations not otherwise possible. Over the life of Stampede 2, the system is expected to serve many thousands of researchers spanning all NSF-supported disciplines, as the current system has done. In addition to being an immediately productive resource for a large community of computational engineers and scientists, Stampede 2 will also continue the community on an evolutionary path to future "many core" computing technologies.

Stampede 2 will employ upcoming generations of Intel's Xeon and Xeon Phi processors, as well as the Intel Omni-Path network fabric. The system will maintain a familiar Linux-based software environment to insure a smooth migration of the large existing user base to the new system. The system and its software stack will be designed to support traditional large scale simulation users, users performing data intensive computations, as well as emerging classes of new and non-traditional users to high performance computing. Stampede 2 will support breakthrough discoveries and advances across a wide range of research topics.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Dan Stanzione, Bill Barth, Tommy Minyard, Niall Gaffney, Chris Hempel, Kelly Gaither, et al "Stampede 2: The Evolution of an XSEDE Supercomputer." PEARC'17 Conference , v.1 , 2017
Dan Stanzione, Bill Barth, Niall Gaffney, Kelly Gaither, Chris Hempel, Tommy Minyard, S. Mehringer, Eric Wernert, H. Tufo, D. Panda, P. Teller "Stampede 2: The Evolution of an XSEDE Supercomputer" PEARC17: Proceedings of the Practice and Experience in Advanced Research Computing 2017 on Sustainability, Success and Impact , v.1 , 2017 , p.1-8 https://dl.acm.org/doi/10.1145/3093338.3093385

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The Stampede2 project procured, deployed, and operated a petascale supercomputer for science and engineering at the Texas Advanced Computing Center (TACC), part of the University of Texas at Austin.  Deployed in 2017, Stampede 2 is still operating today, and will continue to do so through June of 2023, when it will retire after six years of production operations.   To date, the machine has run more than nine million simulation, AI, and data analysis jobs for more than fifty thousand users.  These jobs took more than 10 billion hours of processor time. 

Stampede2 consists of more than six thousand compute servers made by Dell Technologies, with processors from Intel and storage from the Cray division of Hewlett-Packard Enterprise.   The network consisted of a 100Gb high-speed Omnipath fabric, originally provided by Intel, and now supported by Cornelis Networks.  The compute servers included 4,204 Intel Xeon Phi "Knights Landing" processors, and 1,736 servers with dual Intel Xeon Scalable "Sky Lake" processors, for a total of more than 400,000 processor cores, and nearly 20 petaflops of peak performance. 

Since the on-time, on-budget start of production operations in mid-2017, time on Stampede 2 has been allocated quarterly via the XSEDE peer-reveiw process.  More than 3,000 projects received allocations on the machine, across virtually all fields of science.  Typically, requests for the machine were three to four times the available time.  Throughout all four years of operation of the machine, usage has been well over 90% of full capacity, limited only by the complications of scheduling very large simulations of varying size.  In the most recent year of allocations, highlights included multiple projects that improve the endurance of batteries, or reduce the need for scarce materials in constructing batteries.  Other users identified target materials that would allow solar panels to be constructed without the use of lead.   Catalogs of human RNA were produced for the first time through the use of computation on Stampede 2.  Stampede 2 also provided computation for drug discovery and epidemiological models in response to the COVID-19 pandemic.  Other users made use of Stampede 2 to forecast and respond to natural disasters, including wildfires, hurricanes, and tornadoes.   Research in AI has been growing steadily on the machine.  

Operations also included signficant training and outreach components.  There have been hundreds of thousands of visits to the online "Virtual Workshop" for Stampede 2 hosted by project partner Cornell University.  Thousands of people have attended online or in-person training, ranging from week long courses and all day conference workshops to shorter webinars.   Hundreds of students have participated in outreach events, including the summer "Code@TACC" week-long residential events for high school. Students participating in these events were overwhelmingly first generation college students, and tracking data shows attendees enter college in STEM fields at more than 10x the national average. 

Stampede 2 has been reliable, accessible, and overwhelmingly impactful to countless NSF researchers. 


Last Modified: 10/13/2021
Modified by: Daniel Stanzione

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page