ProductIntegrated Video (Included with Motherboard)AMD Instinct™ MI210 Accelerator - 64GB HBM2e - PCIe 4.0 x16 - Passive CoolingNVIDIA® A10 GPU Computing Accelerator - 24GB GDDR6 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)NVIDIA® A30 GPU Computing Accelerator - 24GB HBM2 - PCIe 4.0 x16 - Passive CoolerNVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive CoolingNVIDIA® H100 NVL GPU Computing Accelerator - 94GB HBM3 - PCIe 5.0 x16 - Passive Cooling
ActionSelectSelectSelectSelectSelectSelect
Main Specifications
Product Series AMD InstinctNvidia A10Nvidia A30Nvidia L4Nvidia H100 NVL
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Core Clock Speed 1700 MHz885 MHz (1695 MHz Boost Clock)795 MHz Base | 2040 MHz Boost
Host Interface PCI Express 4.0 x16PCI Express 4.0 x16 64GB/sPCI Express 4.0 x16PCI Express 4.0 x16PCI Express 5.0 x16
GPU Architecture CDNA2AmpereAmpereAda LovelaceHopper
Detailed Specifications
Streaming Processor Cores 6656
Compute Units 104
NVIDIA RT Cores 72 RT Cores
PCIe x16 Interconnect Bandwidth PCIe Gen5: 128GB/s
Memory Clock Speed 1.6 GHz1563 MHz6251 MHz
Memory Interface 4096-bit192-bit
Max Memory Size 64 GB HBM2e24 GB GDDR624 GB HBM224 GB94 GB
Max Memory Bandwidth Up to 1638.4 GB/s600 GB/s933 GB/s300 GB/s7.8TB/s
Infinity Fabric™ Links 3
Peak Infinity Fabric™ Link Bandwidth 100 GB/s
Peak FP64 5.2 teraFLOPS68 teraFLOPs
Peak FP64 Tensor Core 10.3 teraFLOPS134 teraFLOPs
INT8 Tensor Core 250 TOPS | 500 TOPS330 TOPS | 661 TOPS485 TOPS | Sparsity7,916 TOPS
TF32 Tensor Core 62.5 teraFLOPS | 125 teraFLOPS82 teraFLOPS | 165 teraFLOPS120 TFLOPS | Sparsity1,979 teraFLOPs
FP32 22.6 TFLOPs31.2 teraFLOPS10.3 teraFLOPS30.3 TFLOPS134 teraFLOPs
Peak BFLOAT16 Tensor Core 125 teraFLOPS | 250 teraFLOPS165 teraFLOPS | 330 teraFLOPS242 TFLOPS | Sparsity3,958 teraFLOPs
Peak FP16 Tensor Core 125 teraFLOPS | 250 teraFLOPS165 teraFLOPS | 330 teraFLOPS242 TFLOPS | Sparsity3,958 teraFLOPs
Peak FP8 Tensor Core 485 TFLOPS | Sparsity7,916 teraFLOPs
Peak INT4 Tensor Core 500 TOPS | 1,000 TOPS661 TOPS | 1321 TOPS
Total NVLink Bandwidth Third-gen NVLINK: 200GB/s600GB/s
NVENC | NVDEC 2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode
Secure Boot with Root of Trust Yes
NEBS Ready Yes | Level 3
Peak Single Precision Matrix (FP32) Performance 45.3 TFLOPs
Peak Double Precision Matrix (FP64) Performance 45.3 TFLOPs
Peak Double Precision (FP64) Performance 22.6 TFLOPs
Peak INT4 Performance 181 TOPs
Peak bfloat16 181 TFLOPs
ECC Protection Yes (Full-Chip)On by Default
DisplayPort Connectors None | vGPU Only
OS Support Linux x86_64
Cooling PassivePassivePassivePassive
Dual Slot yesSingle-slotDual-slotNoYes
Dimensions 10.5" (267 mm) Board LengthFHFL
Form Factor Full Height6.61” L x 2.71” H (Low-profile)PCIe
Lithography 8 nm
Supplementary Power Connectors 1x8 pin 12V EPSNone1x 8-pin CPU (EPS12V)
Max Graphics Card Power (W) 300W Peak150W165W72W400W
ActionSelectSelectSelectSelectSelectSelect