Earn 14,999 points when you buy me!
The AMD Instinct™ MI300X platform is designed to deliver exceptional performance for AI and HPC.
AMD Instinct™ MI300 Series accelerators are uniquely well-suited to power even the most demanding AI and HPC workloads, offering exceptional compute performance, large memory density, high bandwidth memory, and support for specialized data formats.
AMD Instinct MI300 Series accelerators are built on AMD CDNA™ 3 architecture, which offers Matrix Core Technologies and support for a broad range of precision capabilities—from the highly efficient INT8 and FP8 (including sparsity support for AI), to the most demanding FP64 for HPC.
AMD Instinct MI300X Series accelerators are designed to deliver leadership performance for Generative AI workloads and HPC applications.
304 GPU Compute Units
192 GB HBM3 Memory
5.3 TB/s Peak Theoretical Memory Bandwidth
The AMD Instinct MI300X Platform integrates 8 fully connected MI300X GPU OAM modules onto an industry-standard OCP design via 4th-Gen AMD Infinity Fabric™ links, delivering up to 1.5TB HBM3 capacity for low-latency AI processing. This ready-to-deploy platform can accelerate time-to-market and reduce development costs when adding MI300X accelerators into existing AI rack and server infrastructure.
8 MI300X GPU OAM modules
1.5 TB Total HBM3 Memory
42.4 TB/s Peak Theoretical Aggregate Memory Bandwidth
AMD Instinct MI300A accelerated processing units (APUs) combine the power of AMD Instinct accelerators and AMD EPYC™ processors with shared memory to enable enhanced efficiency, flexibility, and programmability. They are designed to accelerate the convergence of AI and HPC, helping advance research and propel new discoveries.
Offers approximately 2.6X the HPC workload performance per watt using FP32 compared to AMD MI250X accelerators⁷
AMD Instinct accelerators power some of the world’s top supercomputers, including Lawrence Livermore National Laboratory’s El Capitan system. See how this two-Exascale supercomputer will use AI to run first-of-its-kind simulations and advance scientific research.
Product Basics
Name AMD Instinct™ MI300X
Family Instinct
Series Instinct MI300 Series
Form Factor Servers
Launch Date 12/06/2023
GPU Specifications
GPU Architecture CDNA3
Lithography TSMC 5nm | 6nm FinFET
Stream Processors 14,592
Matrix Cores 912
Compute Units 228
Peak Engine Clock 2100 MHz
Peak Eight-bit Precision (FP8) Performance (E5M2, E4M3) 1.96 PFLOPs
Peak Eight-bit Precision (FP8) Performance with Structured Sparsity (E5M2, E4M3) 3.92 PFLOPs
Peak Half Precision (FP16) Performance 980.6 TFLOPs
Peak Half Precision (FP16) Performance with Structured Sparsity 1.96 PFLOPs
Peak Single Precision (TF32 Matrix) Performance 490.3 TFLOPs
Peak Single Precision (TF32) Performance with Structured Sparsity 980.6 TFLOPs
Peak Single Precision Matrix (FP32) Performance 122.6 TFLOPs
Peak Double Precision Matrix (FP64) Performance 122.6 TFLOPs
Peak Single Precision (FP32) Performance 122.6 TFLOPs
Peak Double Precision (FP64) Performance 61.3 TFLOPs
Peak INT8 Performance 1.96 POPs
Peak INT8 Performance with Structured Sparsity 3.92 POPs
Peak bfloat16 980.6 TFLOPs
Peak bfloat16 with Strutured Sparsity 1.96 PFLOPs
Transistor Count 146 Billion
CPU Specifications
AMD EPYC™ CPU Architecture Zen 4
CPU Cores 24
CPU Peak Engine Clock 3700 MHz
Requirements
Thermal Design Power (TDP) 550W | 760W Peak
GPU Memory
Last Level Cache (LLC) 256 MB
Dedicated Memory Size 128 GB
Dedicated Memory Type HBM3
Infinity Cache Yes
Memory Interface 8192-bit
Memory Clock 5.2 GHz
Peak Memory Bandwidth 5.3 TB/s
Memory ECC Support Yes (Full-Chip)
Board Specifications
GPU Form Factor APU SH5 Socket
Bus Type PCIe® 5.0 x16
Infinity Fabric™ Links 8
Peak Infinity Fabric™ Link Bandwidth 128 GB/s
Cooling Passive & Active
Additional Features
Supported Technologies AMD CDNA™ 3 Architecture , AMD Infinity Architecture , AMD ROCm™ - Ecosystem without Borders
RAS Support Yes
Page Retirement Yes
Page Avoidance Yes
SR-IOV Yes
