ProductIntegrated Video (Included with Motherboard)NVIDIA® A10 GPU Computing Accelerator - 24GB GDDR6 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)NVIDIA® A16 GPU Computing Accelerator - 64GB (4x 16GB) GDDR6 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)NVIDIA® A30 GPU Computing Accelerator - 24GB HBM2 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)NVIDIA® A40 GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® A40 GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling (w/o CEC)NVIDIA® L40 ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® H100 NVL GPU Computing Accelerator - 94GB HBM3 - PCIe 5.0 x16 - Passive CoolingNVIDIA® RTX A2000 - 12GB GDDR6 - PCIe 4.0 x16 - Active Cooling (4x mDP)NVIDIA® RTX A6000 - 48GB GDDR6 - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX 6000 Ada Generation - 48GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)
ActionSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelect
Main Specifications
Product Series Nvidia A10Nvidia A16Nvidia A30Nvidia A40Nvidia A40Nvidia L40Nvidia L40SNvidia H100 NVL
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Core Clock Speed 885 MHz (1695 MHz Boost Clock)
Host Interface PCI Express 4.0 x16 64GB/sPCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 5.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16
GPU Architecture AmpereAmpereAmpereAmpereAmpereAda LovelaceAda LovelaceHopper
Product Type WorkstationWorkstationWorkstation
Product Line NVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional Graphics
Memory Technology GDDR6 with ECCGDDR6GDDR6
Memory Capacity 12 GB GDDR6 with ECC48 GB48 GB with ECC
Max Displays 4 Displays4 Displays
Detailed Specifications
Streaming Processor Cores 10752 CUDA Cores10752 CUDA Cores18,1763328 CUDA Cores10752 Shading Units18,176
NVIDIA Tensor Cores 336 Tensor Cores336 Tensor Cores568 | Gen 4104336568
NVIDIA RT Cores 72 RT Cores84 RT Cores84 RT Cores142 | Gen 32684142
PCIe x16 Interconnect Bandwidth PCIe Gen5: 128GB/s
Memory Clock Speed 1563 MHz6001 MHz2000 MHz 16 Gbps effective
Memory Interface 384-bit384-bit192-bit384-bit384-bit
Memory Speeds (GT/s) 14.5Gbps GDDR614.5Gbps GDDR6
Max Memory Size 24 GB GDDR64x 16GB GDDR6 with error-correcting code (ECC)24 GB HBM248 GB GDDR6 with error-correcting code (ECC)48 GB GDDR6 with error-correcting code (ECC)48 GB GDDR6 with ECC48GB GDDR6 with ECC94 GB
Max Memory Bandwidth 600 GB/s4x 232GB/s933 GB/s696 GB/s696 GB/s864 GB/s7.8TB/s
Peak FP64 5.2 teraFLOPS68 teraFLOPs
Peak FP64 Tensor Core 10.3 teraFLOPS134 teraFLOPs
INT8 Tensor Core 250 TOPS | 500 TOPS330 TOPS | 661 TOPS733 teraFLOPS7,916 TOPS
TF32 Tensor Core 62.5 teraFLOPS | 125 teraFLOPS82 teraFLOPS | 165 teraFLOPS183 teraFLOPS1,979 teraFLOPs
FP32 31.2 teraFLOPS10.3 teraFLOPS91.6 teraFLOPS134 teraFLOPs
Peak BFLOAT16 Tensor Core 125 teraFLOPS | 250 teraFLOPS165 teraFLOPS | 330 teraFLOPS362.05 teraFLOPS3,958 teraFLOPs
Peak FP16 Tensor Core 125 teraFLOPS | 250 teraFLOPS165 teraFLOPS | 330 teraFLOPS362.05 teraFLOPS3,958 teraFLOPs
Peak FP8 Tensor Core 733 teraFLOPS7,916 teraFLOPs
Peak INT4 Tensor Core 500 TOPS | 1,000 TOPS661 TOPS | 1321 TOPS733 teraFLOPS
Total NVLink Bandwidth Third-gen NVLINK: 200GB/sNVIDIA NVLink 112.5 GB/s (bidirectional) PCIe Gen4 16 GB/sNVIDIA NVLink 112.5 GB/s (bidirectional) PCIe Gen4 16 GB/sNot supported600GB/s
Multi-Instance GPUs No
Tensor Performance 63.9 TFLOPS1457.0 TFLOPS
NVIDIA CUDA™ Technology Yes
vGPU Software Support NVIDIA vPC/vApps, NVIDIA RTX Virtual Workstation (vWS)
NVENC | NVDEC 3x | 3x (Includes AV1 Encode & Decode)3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust YesYes
NEBS Ready Yes / Level 3Level 3
Transistor Count 13.25 Billion28.3 Billion76.3 billion
DisplayPort Connectors 3x DisplayPort 1.4
A40 is configured for virtualization by default with physical display connectors disabled. The display outputs can be enabled via management software tools.		3x DisplayPort 1.4
A40 is configured for virtualization by default with physical display connectors disabled. The display outputs can be enabled via management software tools.		4x DP 1.4a4x DisplayPort 1.4a
Cooling PassivePassivePassivePassivePassivePassivePassive
Dual Slot Single-slotDual-slotDual-slot2-slot Low-profile2-slot Low-profileYesYes
Dimensions FHFL4.4" (H) x 10.5" (L)4.4" (H) x 10.5" (L)4.4" (H) x 10.5" (L)4.4" (H) x 10.5" (L)2.713" H x 6.6" L4.4" (H) x 10.5" (L)4.4" H x 10.5" L
Form Factor PCIePCIe
Lithography 8 nmSamsung 8nmSamsung 8nm8nmSamsung 8nm4 nm NVIDIA Custom Process
Supplementary Power Connectors None8-pin CPU1x 8-pin CPU (EPS12V)1x 8-pin CPU (EPS12V)1x 8-pin CPU (EPS12V)1x 16-pin PCIe CEM51x 16-pin1x 8-pin EPS1x PCIe CEM5 16-pin
Max Graphics Card Power (W) 150W250W165W300W300W300W350W400W70W300W300W
Processor AmpereAmpere (GA102)NVIDIA Ada Lovelace
Memory Bandwidth 288 GB/sec768 GB/s960 GB/s
Core Clock Speed 1455 MHz Base Clock
1860 MHz Boost Clock
L2 Cache Size 6 MB
API Support CUDA 8.5, OpenCL 2.0
Shader Model 6.5, OpenGL 4.6, DirectX 12 Ultimate (12_2), Vulkan 1.2
Texture Fill Rate 625 GTexel/s
Graphics Resolution 2x 7680 x 4320 at 60 Hz7680 x 4320 x36 bpp at 60 Hz
Peak Double Precision FP64 Performance 1,250 GFLOPS (1:32)
Peak Single Precision FP32 Performance 8.0 TFLOPS38.7 TFLOPS91.1 TFLOPS
Peak Half Precision FP16 Performance 40.00 TFLOPS (1:1)
Multi-GPU Scalability NVLINK 2-way low profile (2-slot and 3-slot bridges) connects 2x NVIDIA RTX A6000
NVLink Interconnect 112.5 GB/s (bidirectional)
RT Core Performance 15.6 TLOPS210.6 TFLOPS
VR Ready Yes
Vulkan API 1.2
DisplayPort Output 4x DisplayPort 1.4a4x DP 1.4a
Mini DisplayPort Output 4x mDP Latching
Minimum Recommended Power, Single Card (W) 700W600
Minimum Recommended Power, 2-Way (W) 850750
Minimum Recommended Power, 3-Way (W) 1000850
Minimum Recommended Power, 4-Way (W) 12001000
Thermal Solution Active HeatsinkActive HeatsinkBlower Active Fan
Slot Height 2-Slot2-Slot2-Slot
ActionSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelect