KL2288

2U 8-GPU Fully Liquid-Cooled AI Compute Tray

Ultra-Dense Peak Performance

The KL2288-E4 is a high-density AI compute tray designed for next-generation LLM training, inference, and reinforcement learning workloads. Built on the NVIDIA HGX™ Rubin NVL8 reference architecture, it integrates 8x NVIDIA Rubin SXM GPUs with NVLink and NVSwitch for high-bandwidth GPU-to-GPU communication.

Powered by dual AMD EPYC™ 9006 processors, the KL2288-E4 combines high CPU performance, PCIe 6.0 connectivity, and DDR5-8000 memory bandwidth in a compact 2U fully liquid-cooled form factor. It is optimized for AI factories, hyperscale AI farms, Neocloud providers, NCPs, and high-density AI data centers.

Next-Generation GPU & Interconnect

Supports 8x NVIDIA HGX™ Rubin NVL8 GPUs with 2.3TB HBM4 memory and 176TB/s total HBM bandwidth

Supports NVLink 6 with up to 28.8TB/s total NVLink bandwidth and 8x 800G network connections

Delivers up to 400 PFLOPS NVFP4 inference and 280 PFLOPS NVFP4 training performance


Full Liquid Cooling & High-Density Design

100% direct liquid cooling with fanless architecture for sustained high-performance AI workloads

2U compute tray with 24kW MaxP TDP and 54V busbar power architecture

Supports L2L in-rack or in-row CDU solutions with 32 LPM inlet flow at 45°C using PG-25


High-Performance x86 Platform

Dual AMD Venice SP7 CPUs with up to 256 cores and PCIe Gen6 connectivity

32x DDR5-8000 RDIMMs, configurable up to 4TB; 8x E1.S NVMe data drives and 2x front-access M.2 NVMe boot drives

Front-access M.2 design enables quick replacement without opening the cover, reducing MTTR


Enhanced Security with EROT Protection (Optional)

Supports EROT (Enhanced Root of Trust) functionality to prevent unauthorized firmware attacks, meeting Zero Trust platform security requirements.

 

Specifications

Model KL2288-E4
Form Factor 2U MGX Rack compatible
Processor 2x AMD EPYC 9006, up to 256 cores, 600W/CPU; PCIe 6.0, CXL 3.1
Memory 32x DDR5 RDIMM DDR5-8000 (1DPC), configurable up to 8TB
GPU NVIDIA HGX™ Rubin NVL8 DLC, 8x 2300W SXM8 GPUs; 2.3TB HBM4
Storage OS: 2x M.2 NVMe, front-access
Data: 8x E1.S NVMe
PCIe 1x FHFL PCIe 6.0 x16 with B4240L
Network Interface 8x OSFP via CX-9; supports IB XDR / 800G Ethernet
Power 54V Busbar
Cooling 100% liquid cooling
L2L In-Rack CDU or In-Row CDU; 32 LPM inlet flow at 45°C, PG-25; fanless
Ports Front: 2x USB3.0, 2x RJ45, 1x MicroUSB, 1x MiniDP
Management DC-SCM BMC Module (ASPEED AST2600)
Security TPM 2.0, ERoT (optional)
Power Consumption MaxP: TDP 24kW, EDP 32.8kW
MaxQ: TDP 20kW, EDP 27.3kW
Dimensions 448mm (W) x 87mm (H) x 800mm (D)
Weight ~66 kg (rack slide must support system weight of 80 kg)

Interested to learn more?