Massive Performance for Next-Generation AI Workloads
KR6288 is an advanced AI system made for hyperscale data centers, delivering high performance with NVIDIA HGX H200 8-GPUs. This server delivers industry-leading 32 PFlops of AI performance and lightning-fast CPU-to-GPU interconnect bandwidth, with the H200 Transformer Engine supercharging training speeds for GPT large language models. Its optimized power efficiency and modular design with flexible configuration makes it ideal for the most demanding AI tasks in various scenarios like hyperscale data centers, AI model training, and metaverse workloads.
 |
Unprecedented AI PerformancePowered by NVIDIA HGX H200 8-GPU 2x latest Intel® Xeon® or AMD EPYC™ processors 32 PFlops of industry-leading AI performance H200 Transformer Engine delivers supercharged training speed for GPT large language models |
|
|
|
 |
Leading Architecture DesignLightning-fast CPU-to-GPU interconnect bandwidth Ultra-high scalable inter-node networking with up to 4.0 Tbps non-blocking bandwidth Optimized cluster-level architecture with 8:8:2 ratio of GPU to compute network to storage network |
|
|
|
 |
Optimized Energy EfficiencyLow air-cooled heat dissipation overhead and high power efficiency 54V, 12V separated power supply with N+N redundancy reducing power conversion loss Direct liquid cooling design with over 80% cold plate coverage keeps PUE ≤1.15 |
|
|
|
 |
Flexible Configurations for AI ScenariosFully modular design and flexible configurations satisfy both on-premises and cloud deployment Easily harness large-scale model training, such as GPT-3, MT-NLG, stable diffusion and Alphafold Diversified SuperPod solutions accelerating the most cutting-edge innovation including AIGC, AI4Science and Metaverse |
Available Models
|
|
|
|---|---|---|
| Form Factor | 6U rack server | |
| GPU | NVIDIA HGX™ H200 8-GPU | |
| CPU | 2x 4th/5th Gen Intel® Xeon® Scalable | 2x AMD EPYC™ 9004 |
| Memory | 32x DDR5 DIMMs, up to 5600 MT/s | 24x DDR5 DIMMs, up to 4800 MT/s |
| Storage | 1. 8x NVMe U.2 2. 16x NVMe/SATA U.2 3. 8x NVMe U.2 + 16x SATA U.2 (RAID) |
|
| Network Options | 1x OCP 3.0, supports NCSI | |
| Cooling | Air cooling Cold-plate liquid cooling |
|
| Management | DC-SCM BMC management module with ASPEED 2600 | |
| Security | TPM 2.0 (Trusted Platform Module) | |
| PSU | 12V: 2700W/3200W CRPS (1+1) redundant 54V: 3200W CRPS (3+3) redundant |
|
| Dimensions | 447mm (W) x 440mm (H) x 860mm (D) | |
