Slurm Remains Top Resource Manager

In mid-June of 2022, Cerebras Systems announced a new feature that allows users to train some of the largest AI models in the world within a single CS-2 machine using a simplified software support scheme. The announcement highlights multiple capabilities that Cerebras sees as their competitive advantages over other companies. Notable examples cited include the ability to accommodate an entire training model within the memory, through Cerebras' Weight Streaming software on the Wafer Scale Engine (WSE), instead of splitting it across processors, as well as the ability for users to manipulate a few inputs within the software scheme and GUI to choose the scale of model desired for training (i.e., GPT-3 13B, GPT-3XL 1.3B). Cerebras claims that this advancement can cut down the setup of large model training runs from months to minutes, with the Cerebras software managing much of the initial setup.

Dating back to 1986, ISC is the world's longest running and Europe's foremost HPC conference. In June 2020, ISC held ISC2020 Digital, an online event for the HPC community. This report summarizes a presentation from that digital conference: an update on the EuroEXA project given by Peter Hopton, founder and innovator behind Iceotope and the VeryPC Group, as well as the chair of both the Data Centre Strategy and Future Computing Systems committees at the British Computer Society (the Chartered Institute for IT).