2021 Use of Public/External Clouds for HPC Workloads, Trends, and Drivers

The US Government's Office of Science and Technology Policy (OSTP) recently released a Federal strategic plan for a whole-of-nation approach to pioneering the future national advanced computing ecosystem that targets key application drivers and strategic objectives considered essential to US leadership, economic competitiveness, and national security. The plan specifically called out three critical application areas:

• • Extreme scale modeling and simulation
  • Data-intensive application workflows
  • End-to-end and real-time application workflows

The plan also arrays a number of key strategic objectives, including:

• • The development of an advanced ecosystem that spans government, academia, non-profits and industry
  • The support of foundational, applied and translational research
  • The expansion of a diverse, capable and flexible workforce

The strategic plan delineates US government agency roles and responsibilities and describes essential operational and coordination structures necessary to support and implement its objectives.

HPC in the cloud has continued on a strong upward trajectory over the last few years, fueled by a concerted effort from CSPs to address the technical capabilities needed to better run HPC jobs in cloud environments. Many CSPs have bolstered their HPC strengths through hiring HPC experts to speak with HPC customers on application-specific issues, such as porting and running hard HPC jobs in the cloud. Further, CSPs are continuously increasing the platforms offered for HPC with the addition of offerings such as high performance processors, access to bare metal, a variety of accelerator options, high-performance interconnects, multiple storage offerings, as well as software packages valuable to HPC customers. These steps have resulted in dramatic advances in cloud adoption over the past two years, including a major growth year in 2019.