ProductNVIDIA® A2 GPU Computing Accelerator - 16GB GDDR6 - PCIe 4.0 x8 - Passive Cooler (w/o CEC)NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive Cooling
ActionSelectSelect
Main Specifications
Product Series Nvidia A2Nvidia L4
Core Type NVIDIA TENSORNVIDIA TENSOR
Core Clock Speed 1440 MHz (1770 MHz Boost Clock)795 MHz Base | 2040 MHz Boost
Host Interface PCI Express 4.0 x8PCI Express 4.0 x16
GPU Architecture AmpereAda Lovelace
Detailed Specifications
Streaming Processor Cores 1280 CUDA Cores
NVIDIA Tensor Cores 40 | Gen 3
NVIDIA RT Cores 10 | Gen 2
Memory Clock Speed 6251 MHz6251 MHz
Memory Interface 128-bit192-bit
Max Memory Size 16 GB GDDR6 ECC24 GB
Max Memory Bandwidth 200 GB/s300 GB/s
INT8 Tensor Core 485 TOPS | Sparsity
TF32 Tensor Core 9 TFLOPS | 18 TFLOPS Sparsity120 TFLOPS | Sparsity
FP32 4.5 TFLOPS30.3 TFLOPS
Peak BFLOAT16 Tensor Core 242 TFLOPS | Sparsity
Peak FP16 Tensor Core 18 TFLOPS | 36 TFLOPS Sparsity242 TFLOPS | Sparsity
Peak FP8 Tensor Core 485 TFLOPS | Sparsity
NVIDIA CUDA™ Technology 11.1 or later
NVENC | NVDEC 2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode
Secure Boot with Root of Trust Yes
NEBS Ready Yes | Level 3
Peak INT4 Performance 72 TOPS | 144 TOPS Sparsity
Peak INT8 Performance 36 TOPS | 72 TOPS Sparsity
ECC Protection On by DefaultOn by Default
DisplayPort Connectors None | vGPU Only
Cooling PassivePassive
Dual Slot Single-slotNo
Dimensions 6.61” L x 2.71” H
Form Factor Low-Profile PCIe6.61” L x 2.71” H (Low-profile)
Max Graphics Card Power (W) 40-60 W | Configurable72W
ActionSelectSelect