Hyperscale AI Server with 500W A100 GPU
KR6288V1 NVLink AI server features high performance, compatibility and expansion capabilities suited for hyperscale data centers. It is the first server to support 2 3rd Gen Intel Xeon Scalable processors and 8 NVIDIA 500W A100 GPUs with NVSwitch interconnect.
KR6288V1 is the industry’s first air-cooled server that supports 500W A100 GPU. It can support up to 12 PCIe expansion cards, dual-width N20X, NV DPU and other smart network cards. Combined with the AIStation resource scheduling platform, it can unleash a maximum compute performance of 5 petaFLOPS.
Leading Technology2 Intel Xeon Scalable processors, using 10nm process 8 NVIDIA A100 GPUs, 600GB/s bandwidth NVSwitch fully interconnected Support multi-instance GPU (MIG), greatly improving GPU resource utilization Up to 10 200G HDR InfiniBand, high-speed interconnection expansion |
|
|
|
Stability & ReliabilitySupport hard/soft RAID scheme to ensure data security N+N redundant power supply to ensure reliable operation of the system Optimized heat dissipation design to support stable work under high ambient temperature Intelligent remote management to quickly locate faults |
|
|
|
Optimal DesignThe industry’s only air-cooled support 500W A100 GPU High performance ratio, GPU: computing IB: storage IB=8:8:2 Modular design, flexible operation, easy operation and maintenance Leading support for N20X, NV-DPU, A/T customer smart network card |
|
|
|
Comprehensive EcosystemExtensive and mature x86+CUDA global development ecology Leading deep learning framework support, TensorFlow/PyTorch/flying paddle, etc. Efficiently support large-scale CV/NLP/NMT/DLRM model training and inference Easily connect with Yuan 1.0 ecosystem partners and provide rich industry AI solutions |
Model | KR6288V1 |
---|---|
Height | 6U |
GPU | 1x HGX A100 8GPU |
CPU | 2x 3rd Intel® Xeon® Scalable processors, TDP 270W, support 3 UPI interconnections |
Chipset | Intel® C621A Series Chipset (Lewisburg-R) |
Memory | 32x DDR4 RDIMM/LRDIMM, up to 3200MT/s |
Storage | 8x 2.5″ NVMe SSD or 16x 2.5″ SATA/SAS SSD |
M.2 | On-board 2x NVMe/SATA M.2 |
PCIe | 10x PCIe 4.0 x16 slots,2x PCIe 4.0 x16 slots (PCIe 4.0 x8 rate) or 6x PCIe 4.0 x16 |
RAID | Optional support RAID0/1/10/5/50/6/60, etc., support Cache super capacitor protection, provide RAID state migration, RAID configuration memory |
NIC | Optional 1 PCIe 4.0 x16 OCP 3.0 network card, rate support 10G/25G/100G |
I/O | Front: 1x USB 3.0,1x USB 2.0,1x VGA,1x RJ45 management port Rear: 1x USB 3.0,1x VGA |
Management | Built-in BMC remote management module, support Redfish/IPMI/SOL/KVM, etc. |
OS | Red Hat Enterprise 7.8 64bit, CentOS 7.8, Ubuntu 18.04 or higher version |
Cooling | N+1 redundant hot-swappable fans |
Power | 6* 3000W 80Plus platinum power supply, support 3+3 redundancy |
Dimensions (WxHxD) | 447mm x 263.9mm x 850mm |
Operating Temperature | 10℃~35℃/50℉~95℉ |
Full Load Weight | ≤88kg |