ProductNVIDIA® A10 GPU Computing Accelerator - 24GB GDDR6 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)NVIDIA® A16 GPU Computing Accelerator - 64GB (4x 16GB) GDDR6 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive CoolingNVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling
ActionSelectSelectSelectSelect
Main Specifications
Product Series Nvidia A10Nvidia A16Nvidia L4Nvidia L40S
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Core Clock Speed 885 MHz (1695 MHz Boost Clock)795 MHz Base | 2040 MHz Boost
Host Interface PCI Express 4.0 x16 64GB/sPCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16
GPU Architecture AmpereAmpereAda LovelaceAda Lovelace
Detailed Specifications
Streaming Processor Cores 18,176
NVIDIA Tensor Cores 568 | Gen 4
NVIDIA RT Cores 72 RT Cores142 | Gen 3
Memory Clock Speed 1563 MHz6251 MHz
Memory Interface 192-bit
Max Memory Size 24 GB GDDR64x 16GB GDDR6 with error-correcting code (ECC)24 GB48GB GDDR6 with ECC
Max Memory Bandwidth 600 GB/s4x 232GB/s300 GB/s864 GB/s
INT8 Tensor Core 250 TOPS | 500 TOPS485 TOPS | Sparsity733 teraFLOPS
TF32 Tensor Core 62.5 teraFLOPS | 125 teraFLOPS120 TFLOPS | Sparsity183 teraFLOPS
FP32 31.2 teraFLOPS30.3 TFLOPS91.6 teraFLOPS
Peak BFLOAT16 Tensor Core 125 teraFLOPS | 250 teraFLOPS242 TFLOPS | Sparsity362.05 teraFLOPS
Peak FP16 Tensor Core 125 teraFLOPS | 250 teraFLOPS242 TFLOPS | Sparsity362.05 teraFLOPS
Peak FP8 Tensor Core 485 TFLOPS | Sparsity733 teraFLOPS
Peak INT4 Tensor Core 500 TOPS | 1,000 TOPS733 teraFLOPS
Total NVLink Bandwidth Not supported
Multi-Instance GPUs No
NVENC | NVDEC 2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust YesYes
NEBS Ready Yes | Level 3Level 3
ECC Protection On by Default
DisplayPort Connectors None | vGPU Only4x DisplayPort 1.4a
Cooling PassivePassivePassivePassive
Dual Slot Single-slotDual-slotNo
Dimensions FHFL4.4" (H) x 10.5" (L)
Form Factor 6.61” L x 2.71” H (Low-profile)
Lithography 8 nm
Supplementary Power Connectors None8-pin CPU1x 16-pin
Max Graphics Card Power (W) 150W250W72W350W
ActionSelectSelectSelectSelect