ProductNVIDIA® A10 GPU Computing Accelerator - 24GB GDDR6 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)NVIDIA® L40 ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling
ActionSelectSelectSelect
Main Specifications
Product Series Nvidia A10Nvidia L40Nvidia L40S
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Core Clock Speed 885 MHz (1695 MHz Boost Clock)
Host Interface PCI Express 4.0 x16 64GB/sPCI Express 4.0 x16PCI Express 4.0 x16
GPU Architecture AmpereAda LovelaceAda Lovelace
Detailed Specifications
Streaming Processor Cores 18,176
NVIDIA Tensor Cores 568 | Gen 4
NVIDIA RT Cores 72 RT Cores142 | Gen 3
Memory Clock Speed 1563 MHz
Max Memory Size 24 GB GDDR648 GB GDDR6 with ECC48GB GDDR6 with ECC
Max Memory Bandwidth 600 GB/s864 GB/s
INT8 Tensor Core 250 TOPS | 500 TOPS733 teraFLOPS
TF32 Tensor Core 62.5 teraFLOPS | 125 teraFLOPS183 teraFLOPS
FP32 31.2 teraFLOPS91.6 teraFLOPS
Peak BFLOAT16 Tensor Core 125 teraFLOPS | 250 teraFLOPS362.05 teraFLOPS
Peak FP16 Tensor Core 125 teraFLOPS | 250 teraFLOPS362.05 teraFLOPS
Peak FP8 Tensor Core 733 teraFLOPS
Peak INT4 Tensor Core 500 TOPS | 1,000 TOPS733 teraFLOPS
Total NVLink Bandwidth Not supported
Multi-Instance GPUs No
vGPU Software Support NVIDIA vPC/vApps, NVIDIA RTX Virtual Workstation (vWS)
NVENC | NVDEC 3x | 3x (Includes AV1 Encode & Decode)3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust YesYes
NEBS Ready Yes / Level 3Level 3
DisplayPort Connectors 4x DP 1.4a4x DisplayPort 1.4a
Cooling PassivePassivePassive
Dual Slot Single-slotYes
Dimensions FHFL4.4" (H) x 10.5" (L)4.4" (H) x 10.5" (L)
Form Factor PCIe
Lithography 8 nm
Supplementary Power Connectors None1x 16-pin PCIe CEM51x 16-pin
Max Graphics Card Power (W) 150W300W350W
ActionSelectSelectSelect