ProductNVIDIA® A2 GPU Computing Accelerator - 16GB GDDR6 - PCIe 4.0 x8 - Passive Cooler (w/o CEC)NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive CoolingNVIDIA® T1000 8GB GDDR6 - PCIe 3.0 x16 - Active Cooling (4x mDP)
ActionSelectSelectSelect
Main Specifications
Product Series Nvidia A2Nvidia L4
Core Type NVIDIA TENSORNVIDIA TENSOR
Core Clock Speed 1440 MHz (1770 MHz Boost Clock)795 MHz Base | 2040 MHz Boost
Host Interface PCI Express 4.0 x8PCI Express 4.0 x16PCI Express 3.0 x16
GPU Architecture AmpereAda Lovelace
Product Type Workstation
Memory Technology GDDR6
Memory Capacity 8 GB
Max Displays 4 Displays
Detailed Specifications
Streaming Processor Cores 1280 CUDA Cores896 CUDA Parallel-Processing Cores
NVIDIA Tensor Cores 40 | Gen 3
NVIDIA RT Cores 10 | Gen 2
Memory Clock Speed 6251 MHz6251 MHz
Memory Interface 128-bit192-bit128-bit
Max Memory Size 16 GB GDDR6 ECC24 GB
Max Memory Bandwidth 200 GB/s300 GB/s
INT8 Tensor Core 485 TOPS | Sparsity
TF32 Tensor Core 9 TFLOPS | 18 TFLOPS Sparsity120 TFLOPS | Sparsity
FP32 4.5 TFLOPS30.3 TFLOPS
Peak BFLOAT16 Tensor Core 242 TFLOPS | Sparsity
Peak FP16 Tensor Core 18 TFLOPS | 36 TFLOPS Sparsity242 TFLOPS | Sparsity
Peak FP8 Tensor Core 485 TFLOPS | Sparsity
NVIDIA CUDA™ Technology 11.1 or later
NVENC | NVDEC 2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode
Secure Boot with Root of Trust Yes
NEBS Ready Yes | Level 3
Peak INT4 Performance 72 TOPS | 144 TOPS Sparsity
Peak INT8 Performance 36 TOPS | 72 TOPS Sparsity
ECC Protection On by DefaultOn by Default
DisplayPort Connectors None | vGPU Only
Cooling PassivePassive
Dual Slot Single-slotNo
Dimensions 6.61” L x 2.71” H2.713” H x 6.137” L
Form Factor Low-Profile PCIe6.61” L x 2.71” H (Low-profile)
Max Graphics Card Power (W) 40-60 W | Configurable72W50W
Processor NVIDIA Turing
Memory Bandwidth 160 GB/s
API Support CUDA C, CUDA C++, DirectCompute 5.0, OpenCL, Java, Python, and Fortran
Shader Model 5.1 (OpenGL 4.5 and DirectX 12)
Graphics Resolution Max Digital Resolution: 7680 x 4320 at 60 Hz
Peak Single Precision FP32 Performance 2.50 TFLOPS
Mini DisplayPort Output x4
Thermal Solution Ultra-quiet active fansink
Slot Height Low-Profile Single Slot
ActionSelectSelectSelect