Complexity, Cost, and Uncertainty Represent the Biggest Challenges in AI Inferencing for HPC

Hyperion Research has just completed a study of AI inferencing practices, trends, and concerns. Data from this study of HPC users integrating AI inferencing technology into their HPC workloads indicated major concerns in the areas of cost management, complexity of integration, and potential technical issues. As shown in previous Hyperion Research studies, the majority of HPC sites, especially in the industrial and commercial sectors, are in various stages of integrating AI technology into their HPC/technical computing workflows. While buy-in on the promises of the technology remain high, there are some major potential roadblocks, especially when it comes to budgeting, ease of use, and the complex realm of hardware and software management.