ProductNVIDIA® A2 GPU Computing Accelerator - 16GB GDDR6 - PCIe 4.0 x8 - Passive Cooler (w/o CEC)NVIDIA® A10 GPU Computing Accelerator - 24GB GDDR6 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)NVIDIA® A30 GPU Computing Accelerator - 24GB HBM2 - PCIe 4.0 x16 - Passive CoolerNVIDIA® A100 GPU Computing Accelerator - 80GB HBM2 - PCIe 4.0 x16 - Passive Cooling
ActionSelectSelectSelectSelect
Main Specifications
Product Series Nvidia A2Nvidia A10Nvidia A30Nvidia A100
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Core Clock Speed 1440 MHz (1770 MHz Boost Clock)885 MHz (1695 MHz Boost Clock)
Host Interface PCI Express 4.0 x8PCI Express 4.0 x16 64GB/sPCI Express 4.0 x16PCI Express 4.0 x16
GPU Architecture AmpereAmpereAmpereAmpere
Detailed Specifications
Streaming Processor Cores 1280 CUDA Cores
NVIDIA Tensor Cores 40 | Gen 3
NVIDIA RT Cores 10 | Gen 272 RT Cores
PCIe x16 Interconnect Bandwidth PCIe Gen4 64 GB/s
Memory Clock Speed 6251 MHz1563 MHz
Memory Interface 128-bit
Max Memory Size 16 GB GDDR6 ECC24 GB GDDR624 GB HBM280 GB
Max Memory Bandwidth 200 GB/s600 GB/s933 GB/s1,935 GB/s
ECC Protection On by Default
Peak FP64 5.2 teraFLOPS9.7 TFLOPS
Peak FP64 Tensor Core 10.3 teraFLOPS19.5 TFLOPS
INT8 Tensor Core 250 TOPS | 500 TOPS330 TOPS | 661 TOPS624 TOPS
TF32 Tensor Core 9 TFLOPS | 18 TFLOPS Sparsity62.5 teraFLOPS | 125 teraFLOPS82 teraFLOPS | 165 teraFLOPS156 TFLOPS
FP32 4.5 TFLOPS31.2 teraFLOPS10.3 teraFLOPS19.5 TFLOPS
Peak BFLOAT16 Tensor Core 125 teraFLOPS | 250 teraFLOPS165 teraFLOPS | 330 teraFLOPS312 TFLOPS
Peak FP16 Tensor Core 18 TFLOPS | 36 TFLOPS Sparsity125 teraFLOPS | 250 teraFLOPS165 teraFLOPS | 330 teraFLOPS312 TFLOPS
Peak INT4 Tensor Core 500 TOPS | 1,000 TOPS661 TOPS | 1321 TOPS
Total NVLink Bandwidth Third-gen NVLINK: 200GB/s600 GB/s (via NVLink Bridge for up to 2-GPUs)
Multi-Instance GPUs 7 MIGs at 10GB
NVIDIA CUDA™ Technology 11.1 or later
Peak INT4 Performance 72 TOPS | 144 TOPS Sparsity
Peak INT8 Performance 36 TOPS | 72 TOPS Sparsity
Cooling PassivePassivePassive
Dual Slot Single-slotSingle-slotDual-slotYes
Dimensions 6.61” L x 2.71” HFHFL
Form Factor Low-Profile PCIe
Lithography 8 nm
Supplementary Power Connectors None1x 8-pin CPU (EPS12V)1x 8-pin CPU (EPS12V)
Max Graphics Card Power (W) 40-60 W | Configurable150W165W300W
ActionSelectSelectSelectSelect