ProductIntegrated Video (Included with Motherboard)NVIDIA® A30 GPU Computing Accelerator - 24GB HBM2 - PCIe 4.0 x16 - Passive CoolerNVIDIA® A40 GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® A100 GPU Computing Accelerator - 80GB HBM2 - PCIe 4.0 x16 - Passive CoolingNVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive CoolingNVIDIA® L40 ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® H100 NVL GPU Computing Accelerator - 94GB HBM3 - PCIe 5.0 x16 - Passive CoolingNVIDIA® RTX A5000 - 24GB GDDR6 - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX A5500 - 24GB GDDR6 - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX 4000 Ada Generation - 20GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX 4500 Ada Generation - 24GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX 5000 Ada Generation - 32GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX 6000 Ada Generation - 48GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)
ActionSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelect
Main Specifications
Product Series Nvidia A30Nvidia A40Nvidia A100Nvidia L4Nvidia L40Nvidia L40SNvidia H100 NVL
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Core Clock Speed 795 MHz Base | 2040 MHz Boost
Host Interface PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 5.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16
GPU Architecture AmpereAmpereAmpereAda LovelaceAda LovelaceAda LovelaceHopper
Product Type WorkstationWorkstationWorkstationWorkstationWorkstation
Product Line NVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional Graphics
Memory Technology GDDR6 with ECCGDDR6 with ECCGDDR6GDDR6GDDR6GDDR6
Memory Capacity 24 GB GDDR6 with ECC24 GB GDDR6 with ECC20 GB GDDR6 ECC24 GB GDDR6 ECC32 GB GDDR6 ECC48 GB with ECC
Max Displays 4 Displays4 Displays4 Displays4 Displays
Detailed Specifications
Streaming Processor Cores 10752 CUDA Cores18,1768192 CUDA Cores10240 CUDA Cores6144 CUDA Cores7,680 CUDA Parallel Processing Cores12,800 CUDA Parallel Processing Cores18,176
NVIDIA Tensor Cores 336 Tensor Cores568 | Gen 4256320192240400568
NVIDIA RT Cores 84 RT Cores142 | Gen 364804860100142
PCIe x16 Interconnect Bandwidth PCIe Gen4 64 GB/sPCIe Gen5: 128GB/s
Memory Clock Speed 6251 MHz
Memory Interface 384-bit192-bit384-bit384-bit160-bit192-bit256-bit384-bit
Memory Speeds (GT/s) 14.5Gbps GDDR6
Max Memory Size 24 GB HBM248 GB GDDR6 with error-correcting code (ECC)80 GB24 GB48 GB GDDR6 with ECC48GB GDDR6 with ECC94 GB
Max Memory Bandwidth 933 GB/s696 GB/s1,935 GB/s300 GB/s864 GB/s7.8TB/s
Peak FP64 5.2 teraFLOPS9.7 TFLOPS68 teraFLOPs
Peak FP64 Tensor Core 10.3 teraFLOPS19.5 TFLOPS134 teraFLOPs
INT8 Tensor Core 330 TOPS | 661 TOPS624 TOPS485 TOPS | Sparsity733 teraFLOPS7,916 TOPS
TF32 Tensor Core 82 teraFLOPS | 165 teraFLOPS156 TFLOPS120 TFLOPS | Sparsity183 teraFLOPS1,979 teraFLOPs
FP32 10.3 teraFLOPS19.5 TFLOPS30.3 TFLOPS91.6 teraFLOPS134 teraFLOPs
Peak BFLOAT16 Tensor Core 165 teraFLOPS | 330 teraFLOPS312 TFLOPS242 TFLOPS | Sparsity362.05 teraFLOPS3,958 teraFLOPs
Peak FP16 Tensor Core 165 teraFLOPS | 330 teraFLOPS312 TFLOPS242 TFLOPS | Sparsity362.05 teraFLOPS3,958 teraFLOPs
Peak FP8 Tensor Core 485 TFLOPS | Sparsity733 teraFLOPS7,916 teraFLOPs
Peak INT4 Tensor Core 661 TOPS | 1321 TOPS733 teraFLOPS
Total NVLink Bandwidth Third-gen NVLINK: 200GB/sNVIDIA NVLink 112.5 GB/s (bidirectional) PCIe Gen4 16 GB/s600 GB/s (via NVLink Bridge for up to 2-GPUs)Not supported600GB/s
Multi-Instance GPUs 7 MIGs at 10GBNo
Tensor Performance 222.2 TFLOPS272.8 TFLOPS327.6 TFLOPS637.8 TFLOPS1044.4 TFLOPS1457.0 TFLOPS
vGPU Software Support NVIDIA vPC/vApps, NVIDIA RTX Virtual Workstation (vWS)
NVENC | NVDEC 2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode3x | 3x (Includes AV1 Encode & Decode)3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust YesYesYes
NEBS Ready Yes | Level 3Yes / Level 3Level 3
ECC Protection On by Default
Transistor Count 28.3 Billion35.8 Billion35.8 billion76.3 billion76.3 billion
DisplayPort Connectors 3x DisplayPort 1.4
A40 is configured for virtualization by default with physical display connectors disabled. The display outputs can be enabled via management software tools.		None | vGPU Only4x DP 1.4a4x DisplayPort 1.4a
Cooling PassivePassivePassivePassivePassivePassive
Dual Slot Dual-slot2-slot Low-profileYesNoYesYes
Dimensions 4.4" (H) x 10.5" (L)4.4" (H) x 10.5" (L)4.4" (H) x 10.5" (L)4.4" H x 10.5" L4.4" H x 10.5" L4.4" (H) x 9.5"(L)4.4" H x 10.5" L4.4" H x 10.5" L4.4" H x 10.5" L
Form Factor 6.61” L x 2.71” H (Low-profile)PCIePCIe
Lithography Samsung 8nm8nm4 nm NVIDIA Custom Process4 nm NVIDIA Custom Process
Supplementary Power Connectors 1x 8-pin CPU (EPS12V)1x 8-pin CPU (EPS12V)1x 8-pin CPU (EPS12V)1x 16-pin PCIe CEM51x 16-pin1x 8-pin PCIe1x 8-pin PCIe1x 16-pin CEM5 PCIe1x 16-pin CEM5 PCIe1x PCIe CEM5 16-pin
Max Graphics Card Power (W) 165W300W300W72W300W350W400W230W230W130W210W250W300W
Processor Ampere (GA103)Ampere (GA102)NVIDIA Ada LovelaceNVIDIA Ada LovelaceNVIDIA Ada LovelaceNVIDIA Ada Lovelace
Memory Bandwidth 768 GB/s768 GB/s360 GB/s432 GB/s576 GB/s960 GB/s
Peak Single-Precision Performance 27.8 TFLOPS65.3 TFLOPS
API Support Graphics: Direct3D 12, Shader Model 6.6, OpenGL 4.68, Vulkan 1.3
Compute: CUDA 11.6, DirectCompute, OpenCL 3.0
Graphics Resolution Max Digital Resolution: 7680 x 4320 x36 bpp at 60 Hz4x 4096 x 2160 @ 120 Hz
4x 5120 x 2880 @ 60 Hz
2x 7680 x 4320 @ 60 Hz
Peak Single Precision FP32 Performance 34.1 TFLOPS26.7 TFLOPS39.9 TFLOPS91.1 TFLOPS
Multi-GPU Scalability 2-way low profile (2-slot and 3-slot bridges) connects 2x NVIDIA RTX A5000Low profile bridges connect two NVIDIA RTX A5500 GPUs
NVLink Interconnect 112.5 GB/sec bidirectional112.5 GB/s (bidirectional)Not SupportedNot SupportedNot Supported
RT Core Performance 54.2 TFLOPS66.6 TFLOPS61.8 TFLOPS92.2 TFLOPS151.0 TFLOPS210.6 TFLOPS
VR Ready Yes
DisplayPort Output 4x DisplayPort 1.4a4x DisplayPort 1.4a4x DP 1.4a
Mini DisplayPort Output 4x mDP 1.4a4x DP 1.4a4x DP 1.4a
Minimum Recommended Power, Single Card (W) 450W450W600
Minimum Recommended Power, 2-Way (W) 650650750
Minimum Recommended Power, 3-Way (W) 850850850
Minimum Recommended Power, 4-Way (W) 100010001000
Thermal Solution Active HeatsinkActive HeatsinkBlower Active FanBlower Active FanBlower Active FanBlower Active Fan
Slot Height 2-Slot2-SlotSingle Slot2-Slot2-Slot2-Slot
ActionSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelect