ProductAMD Instinct™ MI100 Accelerator - 32GB HBM2 - PCIe 4.0 x16 - Passive CoolingAMD Instinct™ MI210 Accelerator - 64GB HBM2e - PCIe 4.0 x16 - Passive CoolingNVIDIA® RTX A6000 - 48GB GDDR6 - PCIe 4.0 x16 - Active Cooling (4xDP)
ActionSelectSelectSelect
Main Specifications
Product Series AMD InstinctAMD Instinct
Core Clock Speed 1502 MHz1700 MHz
Host Interface PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16
GPU Architecture CDNACDNA2
Product Type Workstation
Product Line NVIDIA Professional Graphics
Memory Technology GDDR6
Memory Capacity 48 GB
Detailed Specifications
Streaming Processor Cores 7,680665610752 Shading Units
Compute Units 120104
NVIDIA Tensor Cores 336
NVIDIA RT Cores 84
Memory Clock Speed 1.2 GHz1.6 GHz2000 MHz 16 Gbps effective
Memory Interface 4096-bit4096-bit384-bit
Max Memory Size 32 GB HBM264 GB HBM2e
Max Memory Bandwidth Up to 1228.8 GB/sUp to 1638.4 GB/s
Infinity Fabric™ Links 33
Peak Infinity Fabric™ Link Bandwidth 92 GB/s100 GB/s
FP32 22.6 TFLOPs
NVIDIA CUDA™ Technology Yes
Peak Half Precision (FP16) Performance 184.6 TFLOPs
Peak Single Precision Matrix (FP32) Performance 46.1 TFLOPs45.3 TFLOPs
Peak Double Precision Matrix (FP64) Performance 45.3 TFLOPs
Peak Single Precision (FP32) Performance 23.1 TFLOPs
Peak Double Precision (FP64) Performance 11.5 TFLOPs22.6 TFLOPs
Peak INT4 Performance 184.6 TOPs181 TOPs
Peak INT8 Performance 184.6 TOPs
Peak bfloat16 92.3 TFLOPs181 TFLOPs
ECC Protection Yes (Full-Chip)
Transistor Count 28.3 Billion
OS Support Linux x86_64Linux x86_64
Cooling PassivePassive
Dual Slot yesyes
Dimensions 10.5" (267 mm) Board Length10.5" (267 mm) Board Length4.4" (H) x 10.5" (L)
Form Factor Full Height
Lithography TSMC 7nm FinFETSamsung 8nm
Supplementary Power Connectors 2x PCIe 8-pin connectors1x8 pin 12V EPS1x 8-pin EPS
Max Graphics Card Power (W) 300W300W Peak300W
Processor Ampere (GA102)
Memory Bandwidth 768 GB/s
Core Clock Speed 1455 MHz Base Clock
1860 MHz Boost Clock
L2 Cache Size 6 MB
API Support CUDA 8.5, OpenCL 2.0
Shader Model 6.5, OpenGL 4.6, DirectX 12 Ultimate (12_2), Vulkan 1.2
Texture Fill Rate 625 GTexel/s
Graphics Resolution 7680 x 4320 x36 bpp at 60 Hz
Peak Double Precision FP64 Performance 1,250 GFLOPS (1:32)
Peak Single Precision FP32 Performance 38.7 TFLOPS
Peak Half Precision FP16 Performance 40.00 TFLOPS (1:1)
Multi-GPU Scalability NVLINK 2-way low profile (2-slot and 3-slot bridges) connects 2x NVIDIA RTX A6000
NVLink Interconnect 112.5 GB/s (bidirectional)
VR Ready Yes
Vulkan API 1.2
DisplayPort Output 4x DisplayPort 1.4a
Minimum Recommended Power, Single Card (W) 700W
Minimum Recommended Power, 2-Way (W) 850
Minimum Recommended Power, 3-Way (W) 1000
Minimum Recommended Power, 4-Way (W) 1200
Thermal Solution Active Heatsink
Slot Height 2-Slot
ActionSelectSelectSelect