Hyperion Research LogoHyperion Research Logo_StickyHyperion Research LogoHyperion Research Logo
  • Home
  • Services
    • Consulting Services
    • Artificial Intelligence-High Performance Data Analysis (AI-HPDA)
    • Traditional and Emerging HPC
    • Quantum Computing Continuing Information Service
    • HPC User Forum
    • Worldwide High Performance Technical Server QView
    • Worldwide HPC Server, Verticals and Countries Forecast Database
    • HPC End-User Multi-Client Study 2024
    • High-Performance Computing Pathfinders
    • Cloud Computing Program
  • Team
  • Sample Projects
    • List of Recent Reports
    • Top 10 Predictions for the Global HPC-AI Community for 2025
    • HPC User Forum: Dr. Ann Speed
    • QC Optimization Status and Prospects
    • To Out-compute is to Out-compete: Competitive Threats and Opportunities Relative to U.S. Government HPC Leadership
    • HPC-AI Success Story
    • HPC+AI Market Update SC24
    • Taxonomy
      • AI-HPDA Taxonomy
      • HPC Server Tracking and Application Workload Segments
      • Traditional HPC and AI-HPDA Subverticals
    • NERSC Update, May 2021 HPC User Forum
    • Cloud Computing Changing HPC Spending
    • NASA Bespoke HPC Study
    • ROI with HPC
    • Interview Series
    • Cloud Application Assessment Tool
    • MCS Server Highlights 2021
    • QC User Study 2021
    • HPC Storage Review 2021 First Half Yr
    • Hyperion Research Sponsored Tech Spotlight AMD-Supermicro
    • U.S. HPC Centers of Activity
  • Events
  • Contact
0

$0.00

LOGIN
✕
  • Home
  • Uncategorized
  • Cerebras Announces Capability to Train Largest Models Easily
Awaiting product image

Cerebras Announces Capability to Train Largest Models Easily

$1,500.00

Authors: Alex Norton and Thomas Sorensen

Publication Date: September 2022

Length: 1 pages

Category: Uncategorized
Share
Description

In mid-June of 2022, Cerebras Systems announced a new feature that allows users to train some of the largest AI models in the world within a single CS-2 machine using a simplified software support scheme. The announcement highlights multiple capabilities that Cerebras sees as their competitive advantages over other companies. Notable examples cited include the ability to accommodate an entire training model within the memory, through Cerebras’ Weight Streaming software on the Wafer Scale Engine (WSE), instead of splitting it across processors, as well as the ability for users to manipulate a few inputs within the software scheme and GUI to choose the scale of model desired for training (i.e., GPT-3 13B, GPT-3XL 1.3B). Cerebras claims that this advancement can cut down the setup of large model training runs from months to minutes, with the Cerebras software managing much of the initial setup.

Related Products

    Programming Languages Becoming More Ubiquitous: Most HPC Sites Use C/C++ and Python

    Melissa Riddle and Jaclyn Ludema

    The usage of multiple programming languages is becoming ubiquitous at HPC sites as the number of languages per site continues to rise. C/C++ and Python are particularly popular, with the majority of HPC sites using both languages at least some of the time. This data is from an annual study that is part of the eighth edition of Hyperion Research's HPC end-user-based tracking of the HPC marketplace. It included 181 HPC end-user sites with 3,830 HPC systems.

    June 20 | Uncategorized

    Cloud Resources are Employed at Nearly Half of HPC Sites and are Expected to Gain Additional Popularity

    Jaclyn Ludema and Tom Sorensen

    May 20 | Uncategorized

Have any questions?

365 Summit Ave.
St. Paul MN 55102, USA.

info@hyperionres.com

© 2021 Hyperion Research. All Rights Reserved | Privacy Policy | Website Terms of Use
LOGIN
0

$0.00

✕

Login

Lost your password?