KR6288V1

Ultra performance AI server with scalability and reliability for hyperscale data centers.

Hyperscale AI Server with 500W A100 GPU

KR6288V1 NVLink AI server features high performance, compatibility and expansion capabilities suited for hyperscale data centers. It is the first server to support 2 3rd Gen Intel Xeon Scalable processors and 8 NVIDIA 500W A100 GPUs with NVSwitch interconnect.

KR6288V1 is the industry’s first air-cooled server that supports 500W A100 GPU. It can support up to 12 PCIe expansion cards, dual-width N20X, NV DPU and other smart network cards. Combined with the AIStation resource scheduling platform, it can unleash a maximum compute performance of 5 petaFLOPS.

Leading Technology

2 Intel Xeon Scalable processors, using 10nm process

8 NVIDIA A100 GPUs, 600GB/s bandwidth NVSwitch fully interconnected

Support multi-instance GPU (MIG), greatly improving GPU resource utilization

Up to 10 200G HDR InfiniBand, high-speed interconnection expansion


Stability & Reliability

Support hard/soft RAID scheme to ensure data security

N+N redundant power supply to ensure reliable operation of the system

Optimized heat dissipation design to support stable work under high ambient temperature

Intelligent remote management to quickly locate faults


Optimal Design

The industry’s only air-cooled support 500W A100 GPU

High performance ratio, GPU: computing IB: storage IB=8:8:2

Modular design, flexible operation, easy operation and maintenance

Leading support for N20X, NV-DPU, A/T customer smart network card


Comprehensive Ecosystem

Extensive and mature x86+CUDA global development ecology

Leading deep learning framework support, TensorFlow/PyTorch/flying paddle, etc.

Efficiently support large-scale CV/NLP/NMT/DLRM model training and inference

Easily connect with Yuan 1.0 ecosystem partners and provide rich industry AI solutions

 

Model KR6288V1
Height 6U
GPU 1x HGX A100 8GPU
CPU 2x 3rd Intel® Xeon® Scalable processors, TDP 270W, support 3 UPI interconnections
Chipset Intel® C621A Series Chipset (Lewisburg-R)
Memory 32x DDR4 RDIMM/LRDIMM, up to 3200MT/s
Storage 8x 2.5″ NVMe SSD or 16x 2.5″ SATA/SAS SSD
M.2 On-board 2x NVMe/SATA M.2
PCIe 10x PCIe 4.0 x16 slots,2x PCIe 4.0 x16 slots (PCIe 4.0 x8 rate)
or 6x PCIe 4.0 x16
RAID Optional support RAID0/1/10/5/50/6/60, etc., support Cache super capacitor protection, provide RAID state migration, RAID configuration memory
NIC Optional 1 PCIe 4.0 x16 OCP 3.0 network card, rate support 10G/25G/100G
I/O Front: 1x USB 3.0,1x USB 2.0,1x VGA,1x RJ45 management port
Rear: 1x USB 3.0,1x VGA
Management Built-in BMC remote management module, support Redfish/IPMI/SOL/KVM, etc.
OS Red Hat Enterprise 7.8 64bit, CentOS 7.8, Ubuntu 18.04 or higher version
Cooling N+1 redundant hot-swappable fans
Power 6* 3000W 80Plus platinum power supply, support 3+3 redundancy
Dimensions (WxHxD) 447mm x 263.9mm x 850mm
Operating Temperature 10℃~35℃/50℉~95℉
Full Load Weight ≤88kg