
Effectively Managing HPC/HPDA/AI Storage Requirements: An Increasingly Critical Challenge
$2,500.00
Authors: Mark Nossokoff, Bob Sorensen
Publication Date: November 2020
Length: 4 pages
The growing proliferation of GPUs and related HPDA and HPC-based AI workloads is challenging the HPC storage architectures of conventional CPU-based designs and traditional HPC modeling/simulation workloads. Conventional HPC storage systems manage the well-understood needs of largely independent and segregated home directories and scratch files, keeping the system fully utilized for optimal performance. However, data-intensive HPDA and AI workloads, with much greater variety of heterogenous I/O profiles, are stressing the performance capabilities of the conventional storage systems and related architectures.
Related Products
Department of Energy Announces Request for Proposal for Exascale Computing Platforms to be Delivered Starting in 2021
Alex Larzelere, Bob Sorensen, Earl Joseph, Steve Conway and Alex Norton
This Quick Take looks at the recent announcement by the Department of Energy (DOE) of the release of a Request for Proposal (RFP) for exascale systems to be installed at Oak Ridge National Laboratory (ORNL) and Lawrence Livermore National Laboratory (LLNL) in the 2021-2022 time frame. The RFP also says that a third system (different from the ORNL computer) may be installed at Argonne National Laboratory (ANL) in 2022.
April 2018 | Quick Take
AWS New Bare Metal Instance: Courting the HPC Crowd by Combining Bare Metal Performance with Virtualized Cloud Functionality
Bob Sorensen, Earl Joseph, Steve Conway, Alex Norton
This Quick Take looks at Amazon's recent announcement of a new EC2 Bare Metal offering that provides users with direct, non-virtualized access to a processor, memory, storage and related networking instance. Amazon uses custom hardware in an effort to wring out the highest possible performance from the basic hardware set up while still offering a full complement of cloud-based software support. This development is a positive one for HPC users looking to migrate workloads to public clouds as Amazon is addressing one of the most vexinghurdles of HPC in the cloud: the performance overhead of running applicationsin a virtualized, performance limiting environment.
January 2018 | Quick Take

