ProductNVIDIA® A40 GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling (w/o CEC)NVIDIA® L40 ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® RTX A4000 - 16GB GDDR6 - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX A6000 - 48GB GDDR6 - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX 6000 Ada Generation - 48GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)
ActionSelectSelectSelectSelectSelectSelect
Main Specifications
Product Series Nvidia A40Nvidia L40Nvidia L40S
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Host Interface PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16
GPU Architecture AmpereAda LovelaceAda Lovelace
Product Type WorkstationWorkstationWorkstation
Product Line NVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional Graphics
Memory Technology GDDR6 with ECCGDDR6GDDR6
Memory Capacity 16 GB GDDR6 with ECC48 GB48 GB with ECC
Max Displays 4 Displays4 Displays
Detailed Specifications
Streaming Processor Cores 10752 CUDA Cores18,1766144 CUDA Cores10752 Shading Units18,176
NVIDIA Tensor Cores 336 Tensor Cores568 | Gen 4192336568
NVIDIA RT Cores 84 RT Cores142 | Gen 34884142
Memory Clock Speed 2000 MHz 16 Gbps effective
Memory Interface 384-bit256-bit384-bit384-bit
Memory Speeds (GT/s) 14.5Gbps GDDR6
Max Memory Size 48 GB GDDR6 with error-correcting code (ECC)48 GB GDDR6 with ECC48GB GDDR6 with ECC
Max Memory Bandwidth 696 GB/s864 GB/s
INT8 Tensor Core 733 teraFLOPS
TF32 Tensor Core 183 teraFLOPS
FP32 91.6 teraFLOPS
Peak BFLOAT16 Tensor Core 362.05 teraFLOPS
Peak FP16 Tensor Core 362.05 teraFLOPS
Peak FP8 Tensor Core 733 teraFLOPS
Peak INT4 Tensor Core 733 teraFLOPS
Total NVLink Bandwidth NVIDIA NVLink 112.5 GB/s (bidirectional) PCIe Gen4 16 GB/sNot supported
Multi-Instance GPUs No
Tensor Performance 1457.0 TFLOPS
NVIDIA CUDA™ Technology YesYes
vGPU Software Support NVIDIA vPC/vApps, NVIDIA RTX Virtual Workstation (vWS)
NVENC | NVDEC 3x | 3x (Includes AV1 Encode & Decode)3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust YesYes
NEBS Ready Yes / Level 3Level 3
Transistor Count 17.4 Billion28.3 Billion76.3 billion
DisplayPort Connectors 3x DisplayPort 1.4
A40 is configured for virtualization by default with physical display connectors disabled. The display outputs can be enabled via management software tools.
4x DP 1.4a4x DisplayPort 1.4a
Cooling PassivePassivePassive
Dual Slot 2-slot Low-profileYes
Dimensions 4.4" (H) x 10.5" (L)4.4" (H) x 10.5" (L)4.4" (H) x 10.5" (L)4.4” H x 9.5” L4.4" (H) x 10.5" (L)4.4" H x 10.5" L
Form Factor PCIe
Lithography Samsung 8nm8nmSamsung 8nm4 nm NVIDIA Custom Process
Supplementary Power Connectors 1x 8-pin CPU (EPS12V)1x 16-pin PCIe CEM51x 16-pin1x 6-pin PCIe1x 8-pin EPS1x PCIe CEM5 16-pin
Max Graphics Card Power (W) 300W300W350W140W300W300W
Processor Ampere (GA104)Ampere (GA102)NVIDIA Ada Lovelace
Memory Bandwidth 448 GB/sec768 GB/s960 GB/s
Core Clock Speed 1455 MHz Base Clock
1860 MHz Boost Clock
L2 Cache Size 6 MB
API Support CUDA 8.5, OpenCL 2.0
Shader Model 6.5, OpenGL 4.6, DirectX 12 Ultimate (12_2), Vulkan 1.2
Texture Fill Rate 625 GTexel/s
Graphics Resolution Max Digital Resolution: 7680 x 4320 x36 bpp at 60 Hz7680 x 4320 x36 bpp at 60 Hz
Peak Double Precision FP64 Performance 1,250 GFLOPS (1:32)
Peak Single Precision FP32 Performance 38.7 TFLOPS91.1 TFLOPS
Peak Half Precision FP16 Performance 40.00 TFLOPS (1:1)
Deep Learning TFLOPS 153.4 TFLOPS
Multi-GPU Scalability NVLINK 2-way low profile (2-slot and 3-slot bridges) connects 2x NVIDIA RTX A6000
NVLink Interconnect 112.5 GB/s (bidirectional)
RT Core Performance 210.6 TFLOPS
VR Ready Yes
Vulkan API 1.2
DisplayPort Output 4x DisplayPort 1.4a4x DisplayPort 1.4a4x DP 1.4a
Minimum Recommended Power, Single Card (W) 300W700W600
Minimum Recommended Power, 2-Way (W) 500850750
Minimum Recommended Power, 3-Way (W) 8501000850
Minimum Recommended Power, 4-Way (W) 100012001000
Thermal Solution Active HeatsinkActive HeatsinkBlower Active Fan
Slot Height Single Slot2-Slot2-Slot
ActionSelectSelectSelectSelectSelectSelect