10U 8-OAM AI Server with AMD Instinct™ MI325X Accelerators

KR9298-E3 is a high-performance, general-purpose heterogeneous computing platform designed for large language model inference and cloud computing services. It is equipped with dual-socket SP5 AMD EPYC™ 9005 Series processors (up to 500W each with air cooling) and eight AMD Instinct™ MI325X accelerators. The platform delivers exceptional GPU memory capabilities with 2TB of HBM3e and an impressive 48 TB/s memory bandwidth, making it ideal for demanding AI workloads and scalable compute environments.

Stable and Reliable Design

Partitioned PSU to CPU node with N+N redundancy ensures consistent performance and operational security.

PDU level N+N redundancy and balance, PSU level N+1 redundancy for data integrity and minimized downtime.


Optimized Cooling Design

Front-cabling configuration lowers I/O component temperatures by ~20%, significantly reducing failure rates.

Fewer rear cables improve overall system cooling, ensuring stable operation for large-scale models.


Flexible I/O Expansion

Supports 8 E-W and 4 N-S network channels, catering to diverse workload needs.

Includes support for full height self-developed network cards, offering enhanced scalability and performance.

Specifications

Model KR9298-E3
Form Factor 10U rack server
Processor 2x AMD EPYC™ 9005, TDP up to 500W
GPU AMD Instinct™ MI325X 8-GPU, TDP up to 1000W
Memory 24x DDR5-6400 MT/s RDIMMs
Storage 8x NVMe U.2 drives + 4x NVMe U.2 drives (Optional)
Internal: 2x SATA/NVMe M.2
PCIe 10x PCIe 5.0 x16 FHHL slots + 2x PCIe 5.0 x16 HHHL slots (Optional)
Network Interface 1x OCP 3.0 x16 (Optional)
Ports Front: 3x USB 3.0, 1x USB Type-C, 1x RJ45, 1x MicroUSB, 1x VGA
Cooling Options Air cooling
Fan 20x 8086 hot-swap redundant fans
Management & Security ASPEED AST2600, 1x TPM 2.0 (Trusted Platform Module)
Power Supply 2x 3200W 12V N+N redundant Platinum
6x 3300W 54V Dual AC, N+1 redundant Platinum
Dimensions 447mm (W) x 440mm (H) x 890mm (D)

Interested to learn more?