Deciphering the Drivers and Barriers for HPC Cloud Adoption

HPC in the cloud has continued on a strong upward trajectory over the last few years, fueled by a concerted effort from CSPs to address the technical capabilities needed to better run HPC jobs in cloud environments. Many CSPs have bolstered their HPC strengths through hiring HPC experts to speak with HPC customers on application-specific issues, such as porting and running hard HPC jobs in the cloud. Further, CSPs are continuously increasing the platforms offered for HPC with the addition of offerings such as high performance processors, access to bare metal, a variety of accelerator options, high-performance interconnects, multiple storage offerings, as well as software packages valuable to HPC customers. These steps have resulted in dramatic advances in cloud adoption over the past two years, including a major growth year in 2019.

Hyperion Research has followed the growth of accelerators in HPC for more than 10 years. Accelerators had an initially slow HPC adoption curve but have recently experienced amplified growth. Within the HPC accelerator market, GPUs, particularly those from Nvidia, have dominated. Although originally designed as gaming processors for graphics rendering, GPUs were found to be well suited to a range of HPC applications, plus critical underlying AI functions, such as matrix multiplication, driving impressive performance gains. As a result, many HPC sites across a broad range of verticals are now using accelerators to speed up a larger portion of their increasingly AI-based workloads.