| | | |
Product | NVIDIA® A2 GPU Computing Accelerator - 16GB GDDR6 - PCIe 4.0 x8 - Passive Cooler (w/o CEC) | NVIDIA® A16 GPU Computing Accelerator - 64GB (4x 16GB) GDDR6 - PCIe 4.0 x16 - Passive Cooler | NVIDIA® A30 GPU Computing Accelerator - 24GB HBM2 - PCIe 4.0 x16 - Passive Cooler |
Action | Select | Select | Select |
Main Specifications |
Product Series |
Nvidia A2 | Nvidia A16 | Nvidia A30 |
Core Type |
NVIDIA TENSOR | NVIDIA TENSOR | NVIDIA TENSOR |
Core Clock Speed |
1440 MHz (1770 MHz Boost Clock) | | |
Host Interface |
PCI Express 4.0 x8 | PCI Express 4.0 x16 | PCI Express 4.0 x16 |
GPU Architecture |
Ampere | Ampere | Ampere |
Detailed Specifications |
Streaming Processor Cores |
1280 CUDA Cores | | |
NVIDIA Tensor Cores |
40 | Gen 3 | | |
NVIDIA RT Cores |
10 | Gen 2 | | |
Memory Clock Speed |
6251 MHz | | |
Memory Interface |
128-bit | | |
Max Memory Size |
16 GB GDDR6 ECC | 4x 16GB GDDR6 with error-correcting code (ECC) | 24 GB HBM2 |
Max Memory Bandwidth |
200 GB/s | 4x 232GB/s | 933 GB/s |
Peak FP64 |
| | 5.2 teraFLOPS |
Peak FP64 Tensor Core |
| | 10.3 teraFLOPS |
INT8 Tensor Core |
| | 330 TOPS | 661 TOPS |
TF32 Tensor Core |
9 TFLOPS | 18 TFLOPS Sparsity | | 82 teraFLOPS | 165 teraFLOPS |
FP32 |
4.5 TFLOPS | | 10.3 teraFLOPS |
Peak BFLOAT16 Tensor Core |
| | 165 teraFLOPS | 330 teraFLOPS |
Peak FP16 Tensor Core |
18 TFLOPS | 36 TFLOPS Sparsity | | 165 teraFLOPS | 330 teraFLOPS |
Peak INT4 Tensor Core |
| | 661 TOPS | 1321 TOPS |
Total NVLink Bandwidth |
| | Third-gen NVLINK: 200GB/s |
NVIDIA CUDA™ Technology |
11.1 or later | | |
Peak INT4 Performance |
72 TOPS | 144 TOPS Sparsity | | |
Peak INT8 Performance |
36 TOPS | 72 TOPS Sparsity | | |
ECC Protection |
On by Default | | |
Cooling |
Passive | Passive | |
Dual Slot |
Single-slot | Dual-slot | Dual-slot |
Dimensions |
6.61” L x 2.71” H | | |
Form Factor |
Low-Profile PCIe | | |
Supplementary Power Connectors |
| 8-pin CPU | 1x 8-pin CPU (EPS12V) |
Max Graphics Card Power (W) |
40-60 W | Configurable | 250W | 165W |
Action | Select | Select | Select |