ProductIntegrated Video (Included with Motherboard)NVIDIA® A10 GPU Computing Accelerator - 24GB GDDR6 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)NVIDIA® A30 GPU Computing Accelerator - 24GB HBM2 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive CoolingNVIDIA® L40 ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® H100 GPU Computing Accelerator - 80GB HBM2e - PCIe 5.0 x16 - Passive Cooling (w/o CEC)NVIDIA® RTX 2000 Ada Generation - 16GB GDDR6 ECC - PCIe 4.0 x8 - Active Cooling (4x mDP)NVIDIA® RTX 4000 Ada Generation - 20GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX 4500 Ada Generation - 24GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX 5000 Ada Generation - 32GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX 6000 Ada Generation - 48GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)
ActionSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelect
Main Specifications
Product Series Nvidia A10Nvidia A30Nvidia L4Nvidia L40Nvidia L40SNvidia H100
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Core Clock Speed 885 MHz (1695 MHz Boost Clock)795 MHz Base | 2040 MHz Boost
Host Interface PCI Express 4.0 x16 64GB/sPCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 5.0 x16PCI Express 4.0 x8PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16
GPU Architecture AmpereAmpereAda LovelaceAda LovelaceAda LovelaceHopper
Product Type WorkstationWorkstationWorkstationWorkstation
Product Line NVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional Graphics
Memory Technology GDDR6 with ECCGDDR6GDDR6GDDR6GDDR6
Memory Capacity 16 GB20 GB GDDR6 ECC24 GB GDDR6 ECC32 GB GDDR6 ECC48 GB with ECC
Max Displays 4 Displays4 Displays
Detailed Specifications
Streaming Processor Cores 18,1762816 CUDA Cores6144 CUDA Cores7,680 CUDA Parallel Processing Cores12,800 CUDA Parallel Processing Cores18,176
NVIDIA Tensor Cores 568 | Gen 488192240400568
NVIDIA RT Cores 72 RT Cores142 | Gen 3224860100142
PCIe x16 Interconnect Bandwidth PCIe Gen5: 128GB/s
Memory Clock Speed 1563 MHz6251 MHz
Memory Interface 192-bit128-bit160-bit192-bit256-bit384-bit
Max Memory Size 24 GB GDDR624 GB HBM224 GB48 GB GDDR6 with ECC48GB GDDR6 with ECC80 GB
Max Memory Bandwidth 600 GB/s933 GB/s300 GB/s864 GB/s2.0TB/s
ECC Protection On by Default
Peak FP64 5.2 teraFLOPS24 teraFLOPS
Peak FP64 Tensor Core 10.3 teraFLOPS48 teraFLOPS
INT8 Tensor Core 250 TOPS | 500 TOPS330 TOPS | 661 TOPS485 TOPS | Sparsity733 teraFLOPS3,200 TOPS
TF32 Tensor Core 62.5 teraFLOPS | 125 teraFLOPS82 teraFLOPS | 165 teraFLOPS120 TFLOPS | Sparsity183 teraFLOPS800 teraFLOPS
FP32 31.2 teraFLOPS10.3 teraFLOPS30.3 TFLOPS91.6 teraFLOPS48 teraFLOPS
Peak BFLOAT16 Tensor Core 125 teraFLOPS | 250 teraFLOPS165 teraFLOPS | 330 teraFLOPS242 TFLOPS | Sparsity362.05 teraFLOPS1,600 teraFLOPS
Peak FP16 Tensor Core 125 teraFLOPS | 250 teraFLOPS165 teraFLOPS | 330 teraFLOPS242 TFLOPS | Sparsity362.05 teraFLOPS1,600 teraFLOPS
Peak FP8 Tensor Core 485 TFLOPS | Sparsity733 teraFLOPS3,200 teraFLOPS
Peak INT4 Tensor Core 500 TOPS | 1,000 TOPS661 TOPS | 1321 TOPS733 teraFLOPS
Total NVLink Bandwidth Third-gen NVLINK: 200GB/sNot supported600GB/s
Multi-Instance GPUs NoUp to 7 MIGS @ 10GB each
Tensor Performance 191.9 TFLOPS327.6 TFLOPS637.8 TFLOPS1044.4 TFLOPS1457.0 TFLOPS
vGPU Software Support NVIDIA vPC/vApps, NVIDIA RTX Virtual Workstation (vWS)
NVENC | NVDEC 2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode3x | 3x (Includes AV1 Encode & Decode)3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust YesYesYes
NEBS Ready Yes | Level 3Yes / Level 3Level 3
Transistor Count 19.9 Billion35.8 Billion35.8 billion76.3 billion76.3 billion
DisplayPort Connectors None | vGPU Only4x DP 1.4a4x DisplayPort 1.4a
Cooling PassivePassivePassivePassivePassive
Dual Slot Single-slotDual-slotNoYesYes
Dimensions FHFL4.4" (H) x 10.5" (L)4.4" (H) x 10.5" (L)2.7” H x 6.6”4.4" (H) x 9.5"(L)4.4" H x 10.5" L4.4" H x 10.5" L4.4" H x 10.5" L
Form Factor 6.61” L x 2.71” H (Low-profile)PCIePCIe
Lithography 8 nm4N NVIDIA Custom Process4 nm NVIDIA Custom Process4 nm NVIDIA Custom Process
Supplementary Power Connectors None1x 8-pin CPU (EPS12V)1x 16-pin PCIe CEM51x 16-pin1x 16-pin PCIe CEM51x 16-pin CEM5 PCIe1x 16-pin CEM5 PCIe1x PCIe CEM5 16-pin
Max Graphics Card Power (W) 150W165W72W300W350W350W70W130W210W250W300W
Processor NVIDIA Ada Lovelace (AD107)NVIDIA Ada LovelaceNVIDIA Ada LovelaceNVIDIA Ada LovelaceNVIDIA Ada Lovelace
Memory Bandwidth 224 GB/sec360 GB/s432 GB/s576 GB/s960 GB/s
Peak Single-Precision Performance 12 TFLOPS65.3 TFLOPS
Graphics Resolution 7680 x 4320 x36 bpp at 60 Hz
Peak Single Precision FP32 Performance 26.7 TFLOPS39.9 TFLOPS91.1 TFLOPS
Multi-GPU Scalability Not Supported
NVLink Interconnect Not SupportedNot SupportedNot Supported
RT Core Performance 27.7 TFLOPS61.8 TFLOPS92.2 TFLOPS151.0 TFLOPS210.6 TFLOPS
DisplayPort Output 4x Mini DisplayPort 1.4a4x DP 1.4a
Mini DisplayPort Output 4x mDP 1.4a4x DP 1.4a4x DP 1.4a
Minimum Recommended Power, Single Card (W) 600
Minimum Recommended Power, 2-Way (W) 750
Minimum Recommended Power, 3-Way (W) 850
Minimum Recommended Power, 4-Way (W) 1000
Thermal Solution Blower Active FanBlower Active FanBlower Active FanBlower Active FanBlower Active Fan
Slot Height Dual SlotSingle Slot2-Slot2-Slot2-Slot
ActionSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelect