Supermicro Introduces New H14 Product Line for AI-Ready Data Centres

New Supermicro Systems Enable Customers to Upgrade and Consolidate Data Centres for AI Workloads

DSA Editorial October 11, 2024

3 minutes read

Supermicro, Inc., a total IT solutions provider for Artificial Intelligence (AI), cloud, storage, and 5G/Edge, has launched a new series of servers, GPU-accelerated systems, and storage servers—the H14 lineup—featuring the AMD EPYC™ 9005 Series processors and AMD Instinct™ MI325X GPUs.

The new H14 product line represents one of the most extensive server families in the industry, including Supermicro’s Hyper systems, the Twin multi-node servers, and AI inferencing GPU systems, all available with air or liquid cooling options. The new Zen5 processor core architecture implements full data path AVX-512 vector instructions for CPU-based AI inference and provides 17% better instructions per cycle (IPC) than the previous 4th generation EPYC processor, enabling more performance per core.

H14 Line Powered by AMD EPYC Processors

Supermicro’s new H14 family uses the latest 5th Gen AMD EPYC processors which enable up to 192 cores per CPU with up to 500W TDP (thermal design power). Supermicro has designed new H14 systems including the Hyper and FlexTwin™ systems, which can accommodate the higher thermal requirements. The H14 family also includes three systems for AI training and inference workloads supporting up to 10 GPUs which feature the AMD EPYC 9005 Series CPU as the host processor and two which support the AMD Instinct MI325X GPU.

“Supermicro’s H14 servers have 2.44X faster SPECrate®2017_fp_base performance1 using the EPYC 9005 64 core CPU as compared with Supermicro’s H11 systems using the second generation EPYC 7002 Series CPUs,” said Charles Liang, President and CEO at Supermicro. “This significant performance improvement allows customers to make their data centres more power efficient by reducing the total data center footprint by at least two-thirds2 while also adding new AI processing capabilities. The H14 server family provides the highest performance, density, and power efficiency available through Supermicro’s liquid and air-cooling options, wide selection of system designs, and proven Building Block Solutions.”

“Supermicro’s ‘Building Block Solutions’ has enabled it to consistently deliver time-to-market solutions powered by AMD across a variety of compelling system designs,” said Forrest Norrod, Executive Vice President and General Manager, Data Centre Solutions Group, at AMD. “Our collaboration with Supermicro, along with their in-house engineering design and manufacturing capabilities worldwide combined with their rack-scale integration capability for both air and liquid-cooled systems enables customers of any scale to generate time-to-value from AMD EPYC CPUs and Instinct GPUs.”

Product Families Under the New Lineup

Supermicro’s H14 server lineup consists of the following product families:

Hyper. Supermicro’s flagship enterprise server supports maximum performance from two EPYC 9005 CPUs with up to the maximum 192 cores per CPU at 500W and up to 9TB memory in 24 DIMM slots. With either a 1U chassis with up to 12 2.5″ NVMe/SATA bays or a 2U chassis with up to 24 2.5″ NVMe/SATA bays, the Hyper’s advanced cooling design accommodates the highest performance CPUs for use in demanding AI inference, enterprise or cloud workloads.
CloudDC. This versatile system is optimized for use in cloud data centres and features a single EPYC 9005 CPU with up to 12 2.5″ NVMe/SATA drive bays in a 1U chassis. It’s designed using the OCP (Open Compute Platform) DC-MHS specification (Data Center Modular Hardware System) which ensures compatibility with OCP standards.
GrandTwin™. The GrandTwin is a 4-node compute platform using single EPYC 9005 CPU in a very dense 2U form-factor. This system is often used in multi-server cluster applications such as object storage, virtualisation, and HPC applications.
FlexTwin™. The FlexTwin is a 2U 4-node high-performance high-density compute system with dual EPYC 9005 CPUs per node. The advanced liquid-cooling provides high power efficiency and allows the operation of the highest performance EPYC 9005 CPUs for use in HPC, EDA and other demanding workloads.
5U GPU System. Supermicro’s EPYC CPU-based 5U PCIe GPU system supports up to 10 double-width accelerators for design and visualization applications.
4U GPU System (Liquid Cooled). This highly dense EPYC CPU-based 8-way accelerators platform supports OAM accelerators in the most compact 4U form-factor using advanced liquid-cooling. It is designed for high-performance AI and HPC applications.
8U GPU System. This 8-way accelerator system uses the AMD Instinct MI325X GPU along with the EPYC 9005 CPU for large-scale LLM AI training. The 8U chassis allows deployment in any air-cooled data centre.