Historical View of the HPC On-Premises Server Market in Processors Installed, 2017-2022
The Historical View of the HPC On-Premises Server Market in Processors Installed, 2017-2022 is a summary of key insights gleaned from our QView database, the market tracking database that profiles HPC server sales and related information that goes back the past 20 years.
Historical View of the On-Premises HPC Server Market by Competitive Segment, 2017-2022
The Historical View of the On-Premises HPC Server Market by Competitive Segment, 2017-2022 is a summary of key insights gleaned from our QView database, the market tracking database that profiles HPC server sales and related information that goes back the past 20 years.
Historical View of the HPC Server Accelerators Market, 2017- 2022
The Historical View of the HPC Server Accelerators Market, 2017- 2022 is a summary of key insights gleaned from our QView database, the market tracking database that profiles HPC server sales and related information that goes back the past 20 years.
Historical View of the HPC Server Market by Vendor, 2017- 2022
The Historical View of the HPC Server Market by Vendor, 2017- 2022 is a summary of key insights gleaned from our QView database, the market tracking database that profiles HPC server sales and related information that goes back the past 20 years.
Open Source Community Affirms Commitment to RHEL Compatibility and Linux Source Code Access
CIQ, Oracle, and SUSE have partnered to form the Open Enterprise Linux Association (OpenELA), which focuses on community-driven source code for Enterprise Linux. The trade association aims to encourage the development of Linux distributions that are both compatible with Red Hat Enterprise Linux (RHEL) and can uphold open community standards. This arrangement formalizes what the members consider to be the existing de facto standards of transparency, community involvement, security, free access, open redistribution, and expedient updates.
EuroHPC JU Issues €30M Call for SME HPC Competitiveness
The EuroHPC Joint Undertaking (EuroHPC JU), the EU's main governmental body charged with overseeing the EU's HPC ecosystem, has issued a call to engage with small and medium enterprises (SMEs) offering support for competitiveness and innovation. The primary objective of this endeavor is to empower SMEs with advanced HPC capabilities to drive innovation, enhance competitiveness, and overcome challenges in the digitization of R&D and business processes.
atNorth Recognized for Innovative Approach to Energy Innovation and Sustainable Building Design
atNorth has made the 2023 shortlist for two categories of the UK National Sustainability Awards. This is the second annual National Sustainability Awards, which recognizes organizations within all sectors that are innovating to create a more sustainable and better future. atNorth made the shortlist for the 'Energy Innovation' and the 'Building of the Year' categories. The Energy Innovation Award nomination was for the bespoke direct liquid cooling (DLC) system developed for the atNorth SWE01 datacenter facility in Stockholm, Sweden, in collaboration with CoolIT, a Canadian-based DLC supplier. The DLC and warm water combined system at SWE01 allows for higher rack density and higher peak performance, all while using less power.
Broad Collaboration Enables Environmental Intelligence Research on Derecho at NCAR-Wyoming Supercomputer Center
Recently inaugurated at the NCAR-Wyoming Supercomputer Center (NWSC) in Cheyenne, WY, the Derecho supercomputer is a result of broad collaboration between and support from the state of Wyoming, the University of Wyoming, the University Corporation for Atmospheric Research (UCAR), the National Center for Atmospheric Research (NCAR), the National Science Foundation (NSF), the White House Office of Science and Technology Policy (OSTP), and HPE. Its capabilities will enable scientists and researchers to better model and understand earth science processes to develop environmental intelligence in support of key societal risk management areas against natural events such as hurricanes, wildfires, and floods.
IBM and NASA Create Open-Source Climate Foundation Model
In an announcement made in early August 2023, IBM announced the release of their joint project with NASA, watsonx.ai geospatial foundation model, as open-source on Hugging Face. The model, which is the largest of its kind available in the open-source AI development environment, is also described in the press release as the first open-source AI foundation model built in collaboration with NASA. As part of the Space Act Agreement with NASA, IBM began construction on the model earlier this year to address obstacles the aerospace association faces in analyzing tremendous and growing amounts of climate and geospatial data.
Worldwide HPC Server Market Forecast Update, 2022-2027
This Hyperion Research study presents the latest five-year forecast (2022-2027) for HPC on-premises technical servers. Worldwide revenue for the HPC technical server market in 2022 was $15.4 billion, representing a modest growth (3.9%) over 2021 revenues. Hyperion Research now predicts that the HPC technical server market will grow at a 7.7% CAGR between 2022 and 2027 to reach $22.3 billion in 2027. Compared to the previous version of the forecast, there have been some slight downgrades to the revenues for 2022 through 2025, primarily due to rescheduling of some large exascale systems.
2022 HPC Market Results and a Historical View of the HPC Server Market by Region, 2017-2022
The QView market tracking database includes profiling on all of the HPC server sales for the past 20 years. This report focuses on historical data and trends for the HPC on-premises technical servers by region over the last five years (2017-2022). The QView has recently expanded to incorporate China as a major region. Now the six regions represented in the QView are: North America, EMEA, Japan, China, APAC (without Japan and China), and the rest of the world. As seen below in Figure 1, North America contributed less than half (44.7%) of the worldwide HPC server revenue in 2022, with EMEA contributing just under a third (28.0%).
A Standardized Ethernet for At-Scale HPC and AI Ecosystems
The newly-formed Ultra Ethernet Consortium (UEC) seeks to establish an open, interoperable, high-performance architecture leveraging the broad Ethernet ecosystem. With founding members including AMD, Arista, Broadcom, Cisco, Eviden, HPE, Intel, Meta, and Microsoft, the UEC envisions a system interconnect solution that will capitalize on the ubiquity and flexibility of Ethernet to address demanding heterogenous HPC and AI performance, functionality, and scalability requirements.
RISC-V Gains Ground with New Qualcomm Joint Venture
In a press release from August 4, 2023, Qualcomm Technologies, Inc. announced the formation of a company aimed at the acceleration and future of products based on the open-standard RISC-V instruction set architecture (ISA). Formed with Robert Bosch GmbH, Infineon Technologies AG, Nordic Semiconductor, and NXP Semiconductors, this as of yet unnamed company will also provide reference architectures and help establish industry-wide solutions. The initial focus of the effort will be in the automotive sector, with expectations for expansion to mobile and IoT.
2022 Year-End Worldwide HPC On-premises Market Closes at $30.8B, with Servers Representing Half of the Broader Market
The global on-premises HPC broader market closed 2022 at $30.8B. This represents a 3.6% growth rate over 2021 and a 5.1% CAGR from 2017-2022. The modest growth over 2021 is largely a result of 2021 being such a high growth year, along with global economic uncertainties in 2022. The overall market from 2017-2022 experienced some major inconsistencies, such as supply chain issues caused by the covid-19 pandemic on the downside and the acceptance of what are now the two systems atop the current Top500 list, Frontier and Fugaku.
Professional Services Make Up a Sizable Portion of Overall HPC Budgets
Recent study results indicate that a reasonable percentage of respondents' overall annual HPC budget goes toward HPC-related third-party professional services. Overall, about half of all respondents spend somewhere between 10% and 50% of their overall HPC budgets on HPC-related professional services.
- Industry was much more committed to professional services than the other major sectors, with 27% of industry survey respondents reporting commitment of 10% to less than 20% of their budgets to HPC-related professional services and about one-quarter of industry sites committing between 20% and 30%.
- More than one-third of government respondents report spending between 10% to less than 20% for HPC professional services.
- The academia sector was the least dependent on professional services, with 40% reporting less than 5% of their annual budgets going to HPC-related professional services.
HPC Profiles in Leadership: Barcelona Supercomputing Center
The Barcelona Supercomputing Center-Centro Nacional de Supercomputación (BSC-CNS)1 has long been recognized as one of the leading scientific research and computational science centers in Europe, if not the world. With its mission to "…research, implement, manage, and transfer technology and knowledge in the area of HPC with the aim of facilitating progress in a variety of scientific fields…", BSC-CNS has made significant research and scientific contributions to its primary focus areas of computer, life, earth, and engineering sciences.
HPC System Processor Preference: x86 Continues to Dominate
For the largest HPC system at the surveyed sites, the primary processor type for future system purchases was x86, at 85.2% of the sites, led by Intel (68.0%) and AMD (14.4%). The next largest identified primary processor was the IBM Power or OpenPower chips at 3.9%. Despite its growing visibility in the overall HPC sector, Arm-based components were only a small percentage of the overall processor space at 3.9%. This data is from an annual study that is part of the eighth edition of Hyperion Research's HPC end-user-based tracking of the HPC marketplace. It included 181 HPC end-user sites with 3,830 HPC systems.
First European RISC-V Summit Sees IBM, BSC "Future of Computing" Agreement
In June, at the first ever RISC-V Summit Europe, IBM and the Barcelona Supercomputing Center (BSC) signed a partnership agreement devoted to enhancing and developing advanced technology under their "Future of Computing" initiative. While the initiative is primarily aimed at advancing collaboration between IBM and BSC, it will also contribute to both regional technology capabilities and the overall advanced computing missions of the EU.
HPE Enters Public AI LLM Cloud Market with HPE GreenLake
At their annual HPE Discover conference, HPE announced its entry into the public AI cloud market with their HPE GreenLake for LLMs (large language models) supercomputer as a service offering. HPE GreenLake for LLMs aims to:
-
- Make HPE's leadership-class AI-native supercomputer infrastructure more accessible to users developing and leveraging LLMs for their business operations.
- Deliver turnkey LLMs supporting industry and domain-specific AI applications.
- Strengthen global sustainability and carbon-reduction initiatives partnering with colocation facilities running on nearly 100% renewable energy.
Massive Galaxy Scale Simulations Present Unique Compute Demands
The HPC User Forum was established in 1999 to promote the health of the global HPC industry and address issues of common concern to users. In April 2023, the 82nd HPC User Forum took place in Princeton, New Jersey. This update summarizes a presentation from that conference given by Molly Peeples, tenured associate astronomer at the Space Telescope Science Institute and astrophysics theorist. Also, a research scientist at Johns Hopkins University, Peeples leads the Figuring Out Gas & Galaxies In Enzo (FOGGIE) collaboration. Her discussion at the April 2023 meeting covered some of the recent laboratory activities as well as milestones and her vision for the future. Additional topics included recent activities in the FOGGIE collaboration, simulation domain factors and their relationship to compute demands, as well as the technological future of the field of galaxy simulation.
Frameworks Used for AI, ML, DL, and HPDA Workloads
A part of the annual Hyperion Research HPC Multi-Client study (MCS) tracks the various application frameworks respondents use on their HPC systems to discover trends in user preference for the way applications are built and deployed, as well as trends in the functionalities users desire in their solutions and products. This year's iteration of the MCS found the most popular AI/ML/DL and data intensive frameworks were TensorFlow, PyTorch, Jupyter Notebook, SQL, CUDA, Hadoop, and Spark. This data is from an annual study that is part of the eighth edition of Hyperion Research's HPC end-user-based tracking of the HPC marketplace. It included 181 HPC end-user sites with 3,830 HPC systems.
HPE GreenLake Partners with AWS for Seamless Hybrid Clouds
HPE recently announced at their Discover 2023 conference keynote an outpouring of GreenLake cloud-centered offerings, including a partnership with AWS that promises a more integrated hybrid cloud experience. The goal of the HPE GreenLake/AWS partnership is simplicity for users, provided through a seamless dashboard that offers control of both cloud and on-premises resources. The specifics include features such as increased security and expanded container deployment options for Kubernetes in hybrid environments. HPE emphasized that their partnership will support various users (enterprise and HPC alike), from consulting with new adopters to managing diverse applications and workloads.
System Interconnect Architectures are Expected to Shift with Future HPC Procurements
Much attention is paid to the compute elements of HPC architectures, and rightly so. However, if those elements are not appropriately connected in a balanced and performant manner to other servers and to storage, then the optimizations provided by the server technologies will be unrealized as new bottlenecks appear. While there are multiple approaches for compute and storage interconnect architectures, recent survey data suggests the prevailing architecture is expected to shift from a preference of independent node-node and node-storage networks to a preference of converged networks with respondents' next HPC procurement. This data is from an annual study which is part of the eighth edition of Hyperion Research's high-performance computing (HPC) end-user-based tracking of the HPC marketplace. It included 181 HPC end-user sites with 3,830 HPC systems.
More Sites are Employing Multiple CSPs
As utilization of HPC resources in the cloud continues to grow, users are turning to multiple CSPs to satisfy their HPC cloud resource requirements. Sites surveyed in this study who indicated they utilized HPC resources in the cloud employed an average of approximately two CSPs for their HPC workloads. Reasons for employing a multi-cloud strategy include:
- Gaining access to specialized hardware only available on one CSP platform, like the TPU from Google or the Trainium processor from AWS
- Accessing specific tools or services
- Leveraging a dataset hosted on a specific cloud platform
- Collaborating with other researchers who utilize different platforms
Tape-based Storage Remains as a Key Element for On-Premises Storage Strategies
While innovations associated with HDD capacities, SSD performance, latency, bandwidth, and throughput advancements dominate HPC storage-related investments and headlines, tape-based storage solutions remain a critical part of data center storage architectures. Tape continues to be utilized at roughly half of the sites surveyed, with average tape capacity at those sites being approximately 2.5x greater than average disk (both HDD and SSD) capacity across all surveyed sites. This data is from an annual study which is part of the eighth edition of Hyperion Research's high-performance computing (HPC) end-user-based tracking of the HPC marketplace. It included 181 HPC end-user sites with 3,830 HPC systems.
HPC Users Willing to Pay 10-15% Premium for Faster, Higher Performance Processors and Larger, Faster Memory
When respondents were asked to identify specific system attributes for which they would be willing to pay a 10-15% premium on top of system price, the most desirable attributes were faster or higher performance processors (48%), and larger or faster memory (39%). More than one third of respondents were willing to pay a premium for higher performance external I/O and storage interconnects between nodes (35%) and better density, power, or cooling attributes (32%). In contrast, only a small percentage (9%) expressed a willingness to pay a premium for a specific vendor, and about one in ten indicated that they would not be willing to pay a 10-15% premium for any specific attribute/feature. This data is from an annual study that is part of the eighth edition of Hyperion Research's HPC end-user-based tracking of the HPC marketplace. It included 181 HPC end-user sites with 3,830 HPC systems.
Application Scaling for Typical HPC Site Covers Broad Range from Single-Core to Multi-Node
In a recent study, respondents reported that only about half of all their HPC applications (46.8%) run on multiple nodes, leaving half of the applications running on a single node or less. Looking at the top two applications per site, two-thirds (68.9%) were run on multiple nodes. This suggests that the typical HPC site has at least several important, large-scale applications, and a very large set of single node jobs. This data is from an annual study that is part of the eighth edition of Hyperion Research's HPC end-user-based tracking of the HPC marketplace. It included 181 HPC end-user sites with 3,830 HPC systems.
HPC Users Express Mixed Optimism Towards Adopting Edge Computing
According to recent study results, a quarter of HPC users (28.2%) either currently employ edge computing or expect to within two years. The top motivators driving edge computing growth include improving real-time data collection and processing, accelerating HPC applications, access to IoT devices for data collection, and a wider range of sensor data. Top deterrents dampening edge computing growth include complex and varied IoT formats, inadequate edge vendor support, lack of in-house expertise for integration, and the cost of integrating into existing infrastructure. This data is from an annual study that is part of the eighth edition of Hyperion Research's HPC end-user-based tracking of the HPC marketplace. It included 181 HPC end-user sites with 3,830 HPC systems.
Leveraging Advanced Computing to Achieve Fusion Power at the Princeton Plasma Physics Laboratory
The HPC User Forum was established in 1999 to promote the health of the global HPC industry and address issues of common concern to users. In April 2023, the 82nd HPC User Forum took place in Princeton, New Jersey. This update summarizes a presentation from that conference given by William Dorland, Princeton Plasma Physics Laboratory's (PPPL) first associate laboratory director for computational science. A renowned computational physicist, Dorland leads the effort to fulfill PPPL's expanded mission to develop computational science as a core capability that will provide high-performance computing support to understand and predict fusion plasma physics, design fusion facilities, and simulate complex plasma phenomena. His discussion at the April 2023 meeting covered some of the recent laboratory activities as well as milestones and his vision for the future.
Summary of QC Cloud Access Offerings: Scoping the Wide Range of QC Providers, Technology Options, and Pricing Schemes
Hyperion Research recently undertook an effort to gather information on currently available mechanisms for existing and potential quantum computing (QC) end users to connect to a quantum system through a cloud access model. The effort considered the widest range of currently available options that spanned direct QC access through a specific vendor, such as D-Wave, IBM, and Rigetti, QC cloud access capabilities offered through cloud service providers (CSPs) such as Amazon Braket, Azure Quantum, and Google Cloud, as well as curated access offered by third-party players such as QC Ware, Strangeworks, and Zapata.
2022 HPC End Users Perspectives on Vertical/Application Workload Areas and HPC System Software and Middleware
Key findings from a recent Hyperion Research study showed that accelerated applications are growing as percent of workload, especially in the industry sector. In addition, many HPC users reported that they have or plan to migrate away from CentOS in response to the changing support model. Insights into the critical factors driving these and other trends are detailed in the 2022 iteration of Hyperion Research's annual MCS end users' study, 2022 HPC Multi-Client Study: Vertical/Application Workload Areas and HPC System Software and Middleware. Key findings from the report are summarized in this document.
EuroHPC JU Fortifies Goal of Post-exascale Era Leadership
Building upon the success of the initial phase of its Centres of Excellence (CoE) program, the EuroHPC JU (European HPC Joint Undertaking) recently announced the launch of ten new Centres of Excellence to support research and innovation targeted to develop and adapt HPC applications for the exascale and post-exascale era. The domain-area CoEs will work collaboratively with EU National Competency Centers focused on country-specific resources and research initiatives.
Perspectives on Sustainability in HPC: Current Views and Future Considerations
Sustainability is the societal goal of existing on this planet in a way that meets the needs of today without compromising the needs of future generations. Sustainability in terms of the HPC market can be described as meeting the needs of present users without compromising the needs of future users, with a focus on the extraordinary power requirements of HPC systems. Over the past few years, Hyperion Research has been tracking the growing influence the goal of sustainability has had on HPC procurement decision-making at various HPC sites around the world. HPC site managers/directors have had to consider the current global energy crisis and geopolitical climate alongside the HPC market, and begin planning and implementing ways to make HPC operations at their sites more sustainable.
Top 10 Predictions for the Global HPC Community in 2023
For 2023 and beyond, Hyperion Research makes these predictions for the worldwide HPC market:
1. Strong growth in the leadership-class segment will support modest growth across the global on-premises HPC market.
2. The advanced computing sector and its associated supply chain will become increasingly driven by national and regional government policies that stress domestic capabilities.
3. Sustainability and energy efficiency considerations will become a dominant factor in many procurements.
4. Cloud utilization will shift from predominantly experimentation to predominantly production workloads as users gain familiarity and confidence with cost, performance, and workflow integration expectations. This will include the initial erosion of on-premises spending in the low end of the HPC market.
5. 2023 will be the year of AI regulation.
2022 HPC End Users Perspectives on Trends and Forecast in HPC Storage and Interconnects - Key Findings
Key findings from a recent Hyperion Research study indicate that HPC storage solutions, and associated storage and system interconnects, continue to be critical for HPC infrastructure to deliver optimal capabilities and provide the fastest time to results for the systems' users. Data-intensive workloads driven by new AI/ML/DL workloads, increasing scale of traditional HPC modelling and simulation, emerging edge computing, and emerging composable systems are placing greater demands and requirements on HPC storage systems. Insights into the critical factors driving these and other trends are detailed in the 2022 iteration of Hyperion Research's annual MCS end users' study, 2022 HPC Multi-Client Study: Trends and Forecasts in HPC Storage and Interconnects. Key findings from the report are summarized in this document.
2022 HPC End Users Perspectives on Processors, Coprocessors/Accelerators, and HPC Budgets
Key findings from a recent Hyperion Research study revealed that HPC users see continued dominance of the x86 processor in HPC, led by Intel but with a growing interest in AMD, the nearly universal adoption of coprocessor or accelerators in HPC servers, albeit at low overall systems counts, and modest expectations for HPC budgets growth for the bulk of the sector. Insights into the critical factors driving these and other trends are detailed in the 2022 iteration of Hyperion Research's annual MCS end users' study, 2022 HPC Multi-Client Study: Processors, Coprocessors/Accelerators, and HPC Budgets. Key findings from the report are summarized in this document.
2022 HPC End Users Perspectives on Use of Public/External Clouds for HPC Workloads, Trends, and Drivers
While barriers to cloud adoption persist in some areas, many have been overcome, and users are moving beyond surge and experimentation use cases to an increasing number of production workloads. The cloud market for HPC continues to grow at a strong pace as cloud service providers (CSPs) address the needs and concerns of HPC users as well as the on-going education of users on how to optimize HPC workloads for the cloud. Insights into the critical factors driving these and other trends are detailed in the 2022 iteration of Hyperion Research's annual MCS end users' study, 2022 HPC Multi-Client Study: Use of Public/External Clouds for HPC Workloads, Trends, and Drivers. Key findings from the report are summarized in this document.
US QC Supplier Rigetti's Recent Realignment: Positing Its Larger Implications
In early February 2023, pure-play quantum computing (QC) firm Rigetti Computing Inc announced the layoff of 50 employees, 28% of its staff, fueled in part by an effort to stave off a delisting of its stock from the Nasdaq exchange. To avoid that, Rigetti must maintain a per share price of above $1 for ten consecutive days before a July 24th deadline. The announcement, coupled with a reshuffling of both CFO and CTO positions, also highlighted a revised technology roadmap for Rigetti that concentrates on the delivery of its Ankaa 84 qubit system in the first quarter of 2023, with increased 2-qubit gate fidelity, capable of demonstrating quantum advantage on a practical, operationally relevant problem over counterpart classical solutions.
IonQ Plans to Establish First Dedicated US-based QC Manufacturing Facility
US quantum computing (QC) supplier IonQ recently announced plans to build what it is calling the first US-based QC manufacturing plant. The 65,000 square foot facility, scheduled for completion in the first half of 2024, will be located outside Seattle, Washington and will most likely be targeted for the firm's next-generation 32-qubit Aria quantum computer. The facility is also slated to become IonQ's second internal data center, but there were no announced details whether this new center will either supplant or augment IonQ' s existing cloud service provider relationships with Azure Quantum, Amazon Bracket, and Google Cloud, that currently support access to IonQ systems.
€270 Million Pinned for RISC-V Based European HPC Ecosystem
In a signed agreement published in December of 2022, the EuroHPC Joint Undertaking (EuroHPC JU) called for proposals to fund a €270M effort to develop a European HPC infrastructure built on the RISC-V open ecosystem. The effort also includes fostering an overall open-source RISC-V community, code porting capabilities, and the development of chiplets based on the RISC-V open instruction set architecture (ISA). RISC-V stands apart from other ISAs as an open-standard that is free to license and has no IP requirements. RISC-V currently has a few offerings in the base product but has clear potential in meeting flexibility and customizability needs over proprietary chip counterparts.
AI-Specific Software Use is Low but Poised for Growth
Data collected in the most recent iteration of the Hyperion Research Global End-User Multi-Client Study indicates a strikingly low usage of AI-specific software licenses across all sectors, especially academia and government. This research revealed that only 3.5% of academic and government respondents, combined, were currently using licensed AI software, while the entire survey group exhibited a usage rate of 13.8%. Respondents representing academic sites were the least likely to answer positively in paying for AI software licenses, with a rate of 1.9%, and industry were the most likely at 21.1%. This data indicates an overwhelming preference for open source and in-house solutions for AI software, including training analytics and library interface tools, over proprietary AI[1]specific software offerings currently on the market.
Buyers' Expected HPC Spending Changes: On-Premises and Cloud
According to a recent survey of over 200 HPC sites worldwide, the on-premises and cloud HPC markets are expected to grow over the next five years, although at slightly lower rates than previously anticipated earlier in 2022. Future cloud budgets for HPC workloads are expected to grow at a faster rate than the on-premises market for industry and academic user sites, while government sites are anticipating higher on-premises budget growth.
EU Commits Over €100 Million to Deploy Six Quantum Computers in 2023
The European High-Performance Computing Joint Undertaking (EuroHPC JU) recently announced the selection of six sites to host what could be the first major round of EU government-sponsored quantum computer (QC) procurements. The new QC systems will be integrated into leading EU-based HPC sites including the IT4Innovations National Supercomputing Centre in Czechia, the Barcelona Supercomputer Center in Spain, and Cineca in Italy, as well as key HPC sites in France, Germany, and Poland. The QC systems will be networked to support EU-wide access by academic, commercial and government research facilities. Half of the 2023 €100 million procurement budget will come from the EU and the remainder from the 17 countries participating in the EuroHPC JU. The QC hardware and software for this effort will draw exclusively on EU technology developed under EU-funded quantum initiatives, related national programs, and private investments.
HPC in the Cloud Update
Due to a shift in HPC sites' perception of HPC cloud resources available and in future roadmaps from CSPs, the HPC cloud market continues to be one of the strongest growth markets in today's HPC ecosystem. While the HPC on-premises market is not projected to dramatically change from the steady 6%-8% five-year CAGR seen in years past, the cloud market is currently showing a projected 17.6% five-year CAGR for the next five years.
NOAA and Microsoft Announce Cloud Computing Collaboration to Advance Climate-Ready Nation Mission
The US National Oceanic and Atmospheric Administration (NOAA) and Microsoft have entered into a Cooperative Research and Development Agreement (CRADA), formalizing NOAA's commitment to using Microsoft Azure cloud computing resources in the pursuit of NOAA's mission to build a Climate[1]Ready Nation by 2030. Several initiatives are envisioned whereby NOAA scientists and engineers will work with Microsoft experts to leverage Azure's machine learning and HPC capabilities: ▪ Fast-tracking innovative contributions to NOAA Earth Prediction Innovation Center (EPIC) earth systems modeling and research ▪ Applying machine learning capabilities to improve models supporting air quality, smoke, and particulate pollution forecasts, as well as relevant NOAA climate models ▪ Accelerating NOAA Fisheries' survey and observations data collection and management ▪ Creating new ocean observations cataloging efforts ▪ Designing resilient and accessible weather modeling and forecasting that can incorporate external data sources with NOAA enterprise data
World's First Data Center APU Stood Up in AMD Laboratory
During the recent Wells Fargo 2022 TMT Summit, Mark Papermaster, CTO of AMD, reported that the Instinct MI300 accelerated processing unit (APU) is, as of early December 2022, up and running. Currently confined to their in-house lab, the Instinct MI300 will be used in the exascale supercomputer currently in development at Lawrence Livermore National Laboratory, El Capitan, scheduled to be delivered in 2024. Described by Papermaster as a "true datacenter APU," AMD expects general availability of the processor in 2023. This multi-chiplet processor makes use of both AMD's Zen 4 (x86) CPU architecture and CDNA 3, AMD's GPU architecture, designed specifically with exascale computing in mind, and will be produced by Taiwan's TSCM at the 5nm process node. Papermaster sees this development as an important way to continue introducing greater density and optimization into components now that the sector is no longer in the era of the "old Moore's Law."
‘RISC-V is Inevitable.’ Foundation Chairman Touts the Growingly Advantageous Position of the Open ISA
During the recent SC22 event in Dallas, Texas, RISC-V Foundation Chairman Professor Krste Asanović from the EECS Department at UC, Berkeley gave a presentation detailing the technological and market position of RISC-V and its potential to become a leading ISA, supplanting the slate of proprietary ISAs that currently dominate the sector. According to Asanović, it is only a matter of time before the RISC-V instruction set architecture claims its rightful place in the HPC stack among other industry standards like Ethernet, Posix, or SQL.
Perspectives from SC22
With over 11,000 on-site attendees approaching pre-pandemic levels, and only 700 virtual participants, SC22 in Dallas, TX far exceeded the high expectations of the broad HPC community. There was no shortage of avenues for participants to obtain the latest knowledge relative to market developments and technology innovations occurring across the industry. The Hyperion Research team of analysts has compiled its primary takeaways and perspectives from the event.
IBM Folds Red Hat Storage Operations into the IBM Storage Unit
IBM recently announced that it is combining the Red Hat storage and associated teams with the IBM Storage business unit. The combination aims to bring consistent data storage solutions across on-premises and cloud infrastructures to deliver a unified storage experience regardless of file type.
Cerebras Announces Capability to Train Largest Models Easily
In mid-June of 2022, Cerebras Systems announced a new feature that allows users to train some of the largest AI models in the world within a single CS-2 machine using a simplified software support scheme. The announcement highlights multiple capabilities that Cerebras sees as their competitive advantages over other companies. Notable examples cited include the ability to accommodate an entire training model within the memory, through Cerebras' Weight Streaming software on the Wafer Scale Engine (WSE), instead of splitting it across processors, as well as the ability for users to manipulate a few inputs within the software scheme and GUI to choose the scale of model desired for training (i.e., GPT-3 13B, GPT-3XL 1.3B). Cerebras claims that this advancement can cut down the setup of large model training runs from months to minutes, with the Cerebras software managing much of the initial setup.
Continued Development of DNA-based Storage Solutions
Catalog and Seagate Technology recently announced a collaboration to advance DNA-based technology towards becoming commercially viable storage and computing solution. Catalog brings their molecule designs for storing data in DNA and performing computation across a library of molecules to the partnership, while Seagate Technology will be contributing its silicon-based lab-on-a[1]chip technology to reduce the volume of chemistry required for DNA-based storage and computation.
Chinese Chip Maker Releases GPU Product Line
The development of AI and HPC hardware is currently undergoing a fundamental shift, with many countries recognizing the negative ramifications that can occur when supply chains and technology dependence is based on international relations. A growing urgency for indigenously developed technology has become a staple in many ten-year technology roadmaps worldwide. At the recent Hot Chips 34 conference, Chinese firm Biren Technology announced a new GPU product line, the BR100, one of the first such devices developed in China and targeted for widespread HPC and AI markets. The Chinese advanced computing sector has been an increasingly sensitive geopolitical and economic topic over the past decade, with some domestic IT system suppliers experiencing heavy restrictions from the United States government on access to advanced computing technology from US sources. The announcement of the Biren GPU is a step toward China improving their indigenous HPC and AI capabilities from a hardware perspective, a progressive move targeted to reduce China's dependence on US-based providers including AMD, Intel, and NVIDIA.
Japan, US Renew Commitment to Economic Order in CHIPS Era
During an inaugural ministerial meeting of the U.S.-Japan Economic Policy Consultative Committee (EPCC) in July, a joint statement was presented detailing a renewed and explicit commitment to regional economic stability, fairness, and hardiness. The statement, which includes an action plan, enumerates four main goals: realizing peace and prosperity through rules-based economic order, countering economic coercion and unfair opaque lending practices, promoting and securing critical and emerging technologies and critical infrastructure, and strengthening supply chain resilience. While renewed and steady efforts to maintain regional welfare are an end within themselves, this joint statement takes on an additional layer of complexity and purpose when considered in light of the recent U.S. CHIPS Act, a semiconductor promotion policy whose U.S.-only tone has the potential to cause regional turbulence and heighten international trade tensions.
Innovations in Technology Infrastructure for Space Use Cases
Two recent announcements highlight a growing trend towards partnership and innovation aimed at space-based technical computing and storage infrastructure. The former seeks a 100X increase in computational power via a High-Performance Spaceflight Computing (HPSC) processor, and the latter is exploring appropriate storage media for low-earth orbit satellite focal planes and RF sensor data.
New UK AI Policy Puts Innovation First
A recent United Kingdom policy paper entitled Establishing a pro-innovation approach to regulating AI identifies unique AI-related regulatory challenges, outlines six cross-sectoral potential solutions, and provides a future outlook on bringing these recommendations to reality. The document contributes to the increasingly unique and regionally divergent approach to AI regulation the UK is adopting as part of the greater framework seen in the UK national AI strategy plan published in September 2021. This latest publication, presented to Parliament by the Secretary of State for Digital, Culture, Media and Sport, prominently espouses innovation-forward policy making, while acknowledging and addressing the inherent risks of developing and deploying AI technology. For UK planners, a system of voluntary, regulatory, and quasi-regulatory policies enables greater UK government responsiveness to technological, political, or contextual developments through an evolving cohort of regulatory bodies, all aiding responsible use of AI in respective fields and through different lenses.
US Government Consortium Launches Quantum Network Research Project
The US government recently stood up a consortium of six Washington D.C.-based federal agencies to explore a range of quantum technologies necessary to create, demonstrate, and operate DC-QNet, a regional, multi-kilometer quantum network testbed. The six participating agencies span a range of US government mission agencies including the National Security Agency, the US Naval Research Laboratory, the National Institute of Standards and Technology, and the National Aeronautics and Space Administration. The program targets key underlying technologies needed to implement a metro[1]area quantum network that includes high-fidelity quantum memory, single photon devices, and related network metrology as well as mechanisms to support quantum entanglement between network nodes in a quantum computer. Details about project schedule and budget have not yet been made available, but each participating agency will be responsible for funding its research activities.
Worldwide HPC-based Artificial Intelligence (AI) Market Forecast, 2020-2026
Hyperion Research has been tracking the HPC server market for more than two decades, including systems dedicated to compute-intensive application-focused servers and data-intensive application-focused servers. Within the data-intensive segment, AI-focused systems are poised to overtake traditional data-science focused systems by 2026, growing at a five-year CAGR of 22.7%, reaching $6.5 billion USD. Overall, the data-focused server market is anticipated to reach one-third of the entire HPC server market by 2026 (less than 25% of HPC server market in 2021). The full HPC-based AI forecast is explored in this report.
Worldwide HPC Supercomputer Subsegment Market Forecast Update, 2021-2026
This Hyperion Research study presents the latest five-year forecast (2021-2026) for HPC on-premises Supercomputer systems by subsegments. Overall, the Supercomputer market segment for HPC systems priced at $500,000 or more is projected to represent nearly half of the server market throughout the forecast, reaching $9.5 billion in 2026. This is heavily driven by the large exascale systems expected to be accepted in 2022 to 2026.
Challenges and Opportunities for Securing a Robust US Quantum Computing Supply Chain
Hyperion Research, at the behest of QED-C®, recently conducted a survey seeking information and insights on the various challenges facing the global QC supply chain. Based on a survey of US quantum computing (QC) commercial entities spanning the QC ecosystem, there are significant concerns that there could be a serious QC-related supply chain disruption in the next few years. Potential choke points are widely dispersed across the supply chain spanning assured access to necessary raw materials to a steady supply of trained software experts. Further complicating this issue is that the QC sector is currently in a nascent and rapidly changing state with a spate of new technologies, hardware and software implementations, and related production and distribution schemes yet to be firmly established.
Pan-European Master's Program Created to Address Key HPC Industry Dearth of Operational Talent
Hyperion Research studies have revealed that hiring staff with the requisite HPC-related skillsets is becoming the number one roadblock for growth at many HPC sites. Growing the available talent pool for advanced computing and AI-related careers is critical in order to support and drive scientific research and engineering afforded by the powerful innovations occurring in the fields of HPC and AI. EUMaster4HPC, promoted as the first pan-European Master of Science (MSc) program in High Performance Computing (HPC), was created for this purpose. Discussed in-depth at the recent EuroHPC Summit and funded by the EuroHPC Joint Undertaking, the MSc program will link academic excellence to the current and future challenges of European businesses, industry, and the public sector in the multidisciplinary field of HPC.
Worldwide HPC in the Cloud Forecast, 2020-2026
The cloud market for HPC has undergone a fundamental shift in the past two years. Historically, user sites treated cloud resources primarily as additional to on-premises HPC systems to address peaks in workload demand. Generally, funds for HPC cloud resources were separate from the HPC system budgets and were not commonly critical components in future system procurement planning. Over the past two years, that paradigm has changed dramatically. Hyperion Research has conducted a number of studies that suggest cloud is becoming a major component in future resource planning for many HPC user sites. Many sites are now weighing cloud next to on-premises procurement strategies and altering the size and timing of future on-premises deployments to increase their budget for cloud resources.
Beyond Restart: Checkpointing for the Exascale Era
The HPC User Forum was established in 1999 to promote the health of the global HPC industry and address issues of common concern to users. In March 2022, the 78th HPC User Forum took place virtually. This update summarizes a presentation from that virtual conference given by Rebecca Hartman-Baker, the User Engagement Group Lead at NERSC. In addition to providing some background information and updates on the current activities at NERSC, Hartman-Baker explained new developments in checkpointing technology being leveraged as an enabling technology and the center's vision for the future.
Worldwide HPC Server Market Forecast Update, 2021-2026
This Hyperion Research study presents our updated five-year forecast (2021-2026) for HPC on-premises technical servers. Worldwide revenue for the HPC technical server market in 2021 was $14.7 billion, representing a strong growth (9.1%) over 2020 revenues. Hyperion Research now predicts that the HPC technical server market will grow at a 6.9% CAGR between 2021 and 2026 to reach $20.5 billion in 2026.
Worldwide On-Premises HPC Broader Market Forecast Update, 2021-2026
Hyperion Research forecasts that the worldwide HPC broader market (servers, storage, software, and services) will expand at a 6.4% CAGR to exceed $40B in 2026. HPC servers compose about half of the broader market revenues and are expected to grow at a similar rate (6.9% CAGR) to exceed $20B in 2026. Storage is forecasted to show the highest growth (8.7% CAGR).
A Growing and Changing HPC Applications Landscape
The application software landscape is quickly evolving along with HPC workloads. Independent software vendor (ISV) applications, as opposed to open-source or home-grown, have traditionally been considered the gold standard as the source for many HPC applications and were frequently cited as HPC users' top applications. While ISV revenues continue to rise, open-source application use is growing as well. Although HPC users can be reluctant to change the applications used at their site, developments such as the onset of AI, new types of hardware, and the cloud have spurred many users to explore new applications they may not have considered otherwise. Overall, the HPC application software landscape is rapidly developing in tandem with new HPC infrastructure and use cases.
Consortium Aims to Standardize Chiplet Interconnect
Seeking to establish a die-to-die interconnect standard and foster an open chiplet ecosystem, a strong collection of major chip makers and users recently announced the formation of the UCIe (Universal Chiplet Interconnect Express) industry consortium. The consortium has published version 1.0 of the UCIe specification, covering the die-to-die I/O physical layer, die-to-die protocols, and software stack. Promoter members of the consortium are Advanced Semiconductor Engineering, Inc. (ASE), AMD, Arm, Google Cloud, Intel Corporation, Meta, Microsoft Corporation, Qualcomm Incorporated, Samsung, and Taiwan Semiconductor Manufacturing Company (TSMC)
New Error Correction Scheme Seeks to Advance Quantum Computing Capabilities
Researchers at the US-based Lawrence Berkeley National Lab (LBNL) recently reported a new approach to error mitigation in a quantum computer (QC) that targets error-producing noise, a ubiquitous problem that can severely limit the performance and utility of existing and near-future quantum computers. The method developed at LBNL consists of taking an initial noisy target circuit and constructing an analogous estimation circuit that is configured specifically for accurate noise characterization. The information gathered from running the estimation circuit is then applied to correct the noise in the original target circuit.
Israeli Government Launches Comprehensive Quantum Computing Development Program
The Israel Innovation Authority and the Israel Ministry of Defense (IMOD) recently announced a $62 million USD collaborative effort to establish a domestic quantum computing (QC) infrastructure. The two-pronged approach calls for the Israel Innovation Authority, part of Israel's Ministry of Economy charged with fostering domestic industrial R&D, to focus on developing QC algorithms, applications, and a related software stack to support both on-premises or cloud QC access models. For its part, the IMOD will stand up a national center to develop a complete quantum computer including a quantum processor expected to consist of 30-40 qubits, quantum control capabilities, and I/O interfacing hardware.
Deep Transfer Learning Framework Applied to Radiation Therapy
At the conclusion of 2021, researchers at UNC Charlotte and Duke University Medical Center published results of work done to use transfer learning methods to generate fluence maps for radiation therapy, aimed at providing medical professionals with more capability and information in fighting adrenal cancers. The technique uses a deep transfer learning model trained on a much larger dataset that can be applied to a smaller data set for a specific application.
- The initial model was trained on pancreas treatment plans, then retuned and applied to a smaller set of data points on adrenal cancers. The output of the model generates a fluence map for specific IMRT beam-based treatments for adrenal cancers.
- According to the researchers, this approach is meant to supplement but not replace human expertise in the field and is reliant on human expertise to finetune and improve the AI model.
European Union Seeking to Strengthen Semiconductor Ecosystem
On February 8, 2022, the European Commission formally proposed what's commonly referred to as the European Chips Act. The legislation plans to build on Europe's strengths and address weaknesses to develop a thriving domestic semiconductor ecosystem and resilient supply chain, while setting measures to anticipate and respond to future supply chain disruptions. In the short term, the Act seeks to bolster EU capabilities to anticipate future chips crises, strengthen manufacturing activities in the EU, and support scale-up and innovation across the whole value chain. In the mid- to long-term, it seeks to reinforce Europe's technological leadership while developing mechanisms to support transfer of knowledge from the lab to the fab and position Europe as a technology leader in innovative downstream markets.
Worldwide HPC Market Forecast for Arm-Based HPC Servers
Hyperion Research has been following the rise of Arm processors in HPC for the past few years, tracking the development of processors as well as the evolution of the HPC software ecosystem to take advantage of Arm. Arm recently came into the spotlight with the acceptance of the Fugaku machine at Riken, which claimed the top spot on the Top500. Based on Fujitsu's Arm-based A64fx processor, Fugaku is a powerful and effective HPC system, rising to the top of many major HPC and AI benchmarks. Hyperion Research believes that the Fugaku machine is part of a wider growth of Arm adoption in HPC.
AI-Centered Partnership Between OMRON and Kyoto University Targets Cardiovascular Diseases
At the recent CES 2022 tech event, Japanese corporation OMRON, the world’s leading manufacturer and distributor of personal heart health products and other medical devices, highlighted (and later announced on their website) the activities of their partnership with Kyoto University to develop an AI[1]powered platform that uses remotely gathered patient data to predict cardiovascular diseases at an earlier stage than current averages. Kyoto University is closely tied to the identity of Japan's government and considered Japan's leading research university. They operate a Top500 HPC system on-site in addition to conducting research on the cutting edge Fugaku supercomputer. This new program, part of an ongoing partnership between the two organizations, seeks to explore the use of AI to analyze blood pressure metrics for early detection of cardiovascular diseases faster and with greater accuracy allowing for treatment courses to be changed or taken more quickly.
NVIDIA Acquires Bright Computing, Addressing a Major Issue for HPC Buyers
HPC has long been recognized as indispensable for advancing scientific research, providing more timely and accurate weather forecasting, building better products, and enabling broader adoption of technical computing for AI-driven training and inference. At the same time, HPC has also been recognized as being extremely complex to set up, operate, and maintain. According to recent Hyperion Research studies, over half of the overall HPC market identified the lack of staffing and ease-of-use related issues as barriers for them to acquire additional HPC-based solutions. NVIDIA, a leading HPC hardware component supplier, has announced that it is addressing this issue by acquiring Bright Computing, a leader in software for managing high-performance computing systems used by more than 700 organizations worldwide.
Snapshot of HPC File System Landscape
Results from the most recent Hyperion Research Multi-Client Study (MCS) show continued evolution within HPC file system adoption. The 2021 HPC Multi-Client Study: Trends and Forecasts in HPC Storage and Interconnects report details the storage and interconnect-related responses and analysis associated with the 252 HPC storage systems deployed at 141 global HPC respondent sites representing 2,006 HPC systems. The survey sample had a total of 338 file systems. This Special Study examines file system utilization.
Open Source and Standards Thriving within the HPC Community
Open source and standards have long been a hallmark of the HPC community. Each encourages broad industry participation, wide-ranging collaboration, and a thriving ecosystem with a common goal of robust, interoperable solutions. Key to the success of standards and open source is a stable, neutral governance and support structure. Two new unrelated industry efforts (Apptainer evolving under the auspices of the Open Linux Foundation and DMTCP establishing a public/private open-source partnership) have been embraced by the HPC community to strengthen the standards and open source activities of the HPC ecosystem.
AI Powered Verusen and Machine Compare Partnership Targets Supply Chain Pain Points
In an announcement made in December, 2021, Verusen, a startup specializing in leveraging AI resources to support global supply chains, detailed a recently formed partnership with Machine Compare, a supplier of one of the world's largest databases for machinery and leading B2B marketplace for buyers and sellers of industrial spare parts. The partnership is aimed at enhancing the customer experience, limiting risk, reducing waste, and helping companies conduct materials management and commerce in a new and efficient way. Verusen founder and CEO Paul Noble explains the partnership is targeted to resolve a painful and wasteful process and will ultimately allow manufacturers to realize a whole new level of sustainability. For his part, Machine Compare CEO Ben Findlay is looking for a reduction in downtime, stockouts, and costs. Furthermore, the burdens lifted by the Verusen AI capabilities are targeted to reduce the amount of manpower committed to time-consuming, reactive tasks, allowing for a more proactive and long-term management of goals.
Perspectives on HPC Storage and Interconnects in the Second Half of 2021
Storage and interconnects continue to be important elements of HPC system architecture and are expected to take on even greater significance with increasing demanding and diverse requirements driven by both traditional compute-intensive HPC mod/sim workloads and data-intensive AI workloads. The significance is reflected in recent market data and near-term forecasts, technology adoption and utilization trends, industry announcements in the second half of 2021, and future storage and related technology research direction of Hyperion Research.
US Government Proposed FY 2022 Budget Targets Increased Funding to Support Domestic Quantum Information Science
The US Office of Science and Technology Policy recently released its second annual National Quantum Initiative (NQI) report, a supplement to the President's FY22 Budget Request that outlines the major US government quantum information science (QIS) research activities and related funding levels out to FY 2022. As seen in Figure 1, the proposed FY2022 budget, which is targeted for about $880 million, calls for an increase of nearly 11% from the previous year. Roughly half of the funding is to come from the NQI and the other half from base agency-specific QIS R&D budgets. The figure represents the sum of Federal budgets for U.S. QIS R&D efforts in over a dozen agencies including NIST, NSF, DOE, NASA, DOD, and DHS, and it also aggregates several QIS subtopics such as computing, networking, sensing, fundamental science, and end quantum-related use cases
Unraveling a Blip in the Worldwide On-Premises Technical Server Forecast
Hyperion Research recently released its updated annual 5-year forecast for the on-premises technical server market, also referred to as the HPC server market, Worldwide On-premises HPC Broader Market Forecast Updates, 2020-2025. While projecting a steady overall 8% CAGR over the 5-year period, the forecast includes a drop in projected on-premises technical server revenues between 2024 and 2025. Although not a common occurrence, there is precedence for such a pullback in the sector, and in this particular instance a confluence of three trends is contributing to this phenomenon.
Indigenous Supply Chain, Quantum Acceleration Among European Commission Goals for 2021-27
The HPC User Forum was established in 1999 to promote the health of the global HPC industry and address issues of common concern to users. In September 2021, the 77th HPC User Forum took place virtually. This update summarizes a presentation from that virtual conference given by Leonardo Flores Añover, Senior Expert at the HPC & Quantum Technology Unit at the European Commission. He provided insights and updates on the current and future developments of HPC in the European Union and the EuroHPC joint undertaking as well as insights into their new HPC policy environment, the state of play in the EU, and drivers of the Union's HPC strategy.
2021 Verticals, Applications, Software, and Middleware Multi-Client Study Key Findings
Understanding the HPC market by application segment continues to be essential as many key behaviors, such as spending habits and emerging technology adoption, are closely related to specific application areas. Verticals, applications, software, and middleware are all inextricably linked and key to accurately characterizing HPC site workloads. Important developments in these areas are explored in the 2021 iteration of Hyperion Research's annual HPC Multi-Client Study: Vertical/Application Workload Areas and Technical Computing System Software and Middleware report. Key findings from the report are summarized in this document.
2021 AI, HPDA, and Future Technology Trends
AI and HPDA applications continue to grow in utilization and importance in the HPC space, altering the direction of system architecture and design as well as widening the scope of HPC and AI. HPC system architects now have to factor in a variety of processor technologies as well as interconnect, storage, and memory configurations to handle a more diverse set of workloads. Not only are HPC sites adopting emergent AI and HPDA workloads, but some are applying AI techniques to traditional modelling and simulation workloads to uncover new capabilities and solutions. This frequent pairing of simulation and analytics requires that HPC system designs be both compute and data friendly. As a result, recent designs are starting to reverse the emphasis on compute-centrism of past decades and establishing a better balance. Insights into the critical factors driving these and other trends are detailed in the 2021 iteration of Hyperion Research's annual Multi-Client Study (MCS) end users' report, AI and HPDA Usage and Future Technology Trends. Key findings from the report are summarized in this document.
2021 Use of Public/External Clouds for HPC Workloads, Trends, and Drivers
Users continue to run an increasing amount of their HPC workloads in the cloud. Recent Hyperion Research studies show that while heretofore the HPC cloud spending was largely complementary and incremental to on-premises HPC spending, there is growing evidence that on-premises spending is being either delayed or foregone altogether in lieu of cloud spending. Insights into the critical factors driving the trend are detailed in the 2021 iteration of Hyperion Research's annual MCS end user study, Use of Public/External Clouds for HPC Workloads, Trends, and Drivers report. Key Findings from the report are summarized in this document.
Worldwide HPC Market Forecast by Vertical, 2020-2025
Hyperion Research forecasts that the worldwide HPC technical server market to grow at 8.0% CAGR to 2025. Within the 13 verticals tracked, five are expected to exceed $1B in revenue in 2021, and three others are poised to pass that mark in the forecast period.
Worldwide HPC Market Forecast by Geographic Region, 2020-2025
Hyperion Research forecasts that the worldwide HPC server market will reach $14.5B in 2021. Nearly half of the worldwide spend on HPC servers currently come from North America, primarily from US customers. Hyperion Research anticipates that the worldwide HPC technical server market will grow at an 8.0% CAGR over the forecast period (2020-2025) to reach nearly $20B in 2025.
Worldwide on Premises HPC Broader Market Forecast Update, 2020-2025
Hyperion Research forecasts that the worldwide HPC broader market (servers, storage, software, and services) will expand at a 7.9% CAGR to nearly $40B in 2025. HPC servers comprise about half of broader market revenues and are expected to grow at a similar rate (8.0% CAGR) to reach nearly $20B in 2025. Storage is forecasted to show the highest growth (9.3% CAGR).
Catalog Looks to DNA as High-Density Storage Solution
The HPC User Forum was established in 1999 to promote the health of the global HPC industry and address issues of common concern to users. In September 2021, the 77th HPC User Forum took place virtually. This update summarizes a presentation from that virtual conference given by Dave Turek, the Chief Technology Officer at Catalog, a new company focused on biological computing. Turek provided insights on biological methods of storing information and how his team is seeking to help shift storage and compute paradigms and create tools to manage the recent and continuing explosion of useful data.
2021 Storage and Interconnect Multi-Client Study Key Findings
Although technical servers and their associated compute and memory elements receive much of HPC infrastructure focus and attention, storage and interconnects are becoming increasingly prominent elements within the HPC ecosystem. This is reflected in the 2021 iteration of Hyperion Research's annual HPC Multi-Client Study: Trends and Forecasts in HPC Storage and Interconnects report. Key findings from the report are summarized in this document.
Worldwide HPC-based Artificial Intelligence (AI) Market Forecast, 2020-2025
As AI and Big Data/HPDA applications continue to grow in importance and focus for HPC data centers and users worldwide, the demand for dedicated HPDA and AI systems are increasing at a rate nearly double that of the overall HPC market. By 2025, Hyperion Research expects roughly one-third of all system revenue to be dedicated to HPDA and AI-centric systems, in a category defined as Data[1]Centric HPC Systems. The portion of the data-centric market focused on AI applications is experiencing even higher growth, nearly 23% CAGR over the five year period, driven by the influx of AI workloads not only for new application spaces but also as a supplemental tool for the traditional simulations that have dominated the HPC space for decades. Some important HPDA workloads require analytics alone, while many benefit from combining established simulation and newer analytics methods, especially machine and deep learning.
2021 End Users Perspectives on Processors, Coprocessors/Accelerators, and HPC Budgets
A recent survey revealed that HPC end users are looking to change the way they outfit their next HPCs, with many interested in exploring new types of processors, relying increasingly on GPUs and other accelerators to support computational gains, and preparing to increase their budgets to afford continued acquisition of more powerful HPCs. Insights into the critical factors driving these and other trends are detailed in the 2021 iteration of Hyperion Research's annual MCS end users' study, Processors, Coprocessors/Accelerators, and HPC budgets. Key Findings from the report are summarized in this document.
AI Engineers in India Alleviate Effects of Water Scarcity
The August 2021 issue of the International Research Journal of Engineering and Technology (IRJET), a peer-reviewed research journal, included a paper based on the work of three researchers from India's St. Francis Institute of Technology (SFIT) summarizing their use of artificial intelligence (AI) and machine learning (ML) methods to help alleviate water shortages in India caused by population growth, urbanization, and climate change. Verlekar, Shah, and Kulkarni used a machine learning model to create a proactive scheme for managing local water resources, work that was prompted by a 2019 drought that impacted the Chennai area of India.
HPC Cloud Forecast 2020-2025
Hyperion Research is projecting the HPC cloud market to exhibit a five-year CAGR of nearly 17% and reach $9.3 billion in end user spending in 2025. The key verticals driving much of the growth include: the bio-sciences and manufacturing sectors, as well as the economics/finance sector and the EDA sector, to name a few.
Berkeley Lab and Collaborators Seek New Security Paradigm
In September 2021, the 77th HPC User Forum took place virtually. This update summarizes a presentation from that virtual conference given by Dr. Sean Peisert, computer security research lead and staff scientist and Lawrence Berkeley National Laboratory. He provided insights on security in high-performance computing environments, specifically about how emerging technologies and research can advance cybersecurity as an enabling capability as opposed to an impedance to optimal performance or other barrier for users.
Verne Global Acquired by UK Investment Company
HPC datacenters have been improving their energy consumption and environmental sustainability profiles. Verne Global, a high-intensity-compute cloud colocation services provider, has emerged as a leader in delivering 100 percent renewable, global HPC cloud resources, powered by Iceland's natural hydroelectric and geothermal energy. Digital 9 Infrastructure plc (D9), a newly formed UK- based investment trust company that invests in a range of digital infrastructure assets, has acquired Verne Global in a deal valued at approximately £231 million.
International Collaborators Create Guide for Understanding AI in Healthcare
During the recent conference held by the Special Interest Group on Knowledge Discovery and Data Mining held in Singapore, three international public science policy advocacy groups presented a guide, Using Artificial Intelligence to Support Healthcare Decisions, aimed at empowering and educating the public on the growing use of AI platforms in the healthcare decision-making process. The guide covers explanations of common applications of artificial intelligence platforms in healthcare and, more importantly, outlines specific questions one can pose to cut to the core of the efficacy and reliability of an AI platform in those applications.
In Pursuit of a DNA Computer
CATALOG recently announced major advancements in developing both storage and computers based on synthetic DNA as the fundamental building block. Continuous innovations in high performance computing (HPC) architectures are required by the ever-increasing challenges that scientists, researchers, and data analysts are expected to overcome. Traditional architectures are evolving as best they can to address each of the above areas. At some point, however, investments in traditional architectures will reach diminishing returns for certain workloads and use cases, driven by some economic reality. One promising non-traditional approach being actively pursued to address these complex challenges is the use and application of synthetic DNA for both storage and computational applications.
Barcelona Supercomputing Center Trains Spanish NLP Model
Recently, the Barcelona Supercomputing Center (BSC) trained the first large artificial intelligence (AI) model designed to understand, speak, and write in the Spanish language. The system, named MarIA, was trained on the MareNostrum supercomputer at the BSC, leveraging 59 TBs of language data from the Biblioteca Nacional de España, one of the world's largest public libraries. The model is said to be an expert in both writing and understanding the Spanish language and is free to use by any developer, company, or entity. The system has a wide variety of potential applications including summarization applications, chatbots, smart searches, translation engines, and automatic subtitling chatbots.
US Department of Defense Considers AI's Role in Future Decision Making Process
Late last month, US Department of Defense (DOD) leadership explored the potential to inculcate artificial intelligence (AI) processes into its overall military operations, signaling a fundamental change in how information and data are used to increase the decision space for leaders both in military and civilian domains. Delivered during the third and most recent iteration of the Global Information Dominance Experiment (GIDE 3), which included representatives from all 11 combatant commands, NORTHCOM Commander Gen. Glen D. VanHerck's remarks on AI were aimed at progressing the ability to maintain domain awareness, achieve information dominance, and provide decision superiority in both competition and crisis.