ProductNVIDIA® A30 GPU Computing Accelerator - 24GB HBM2 - PCIe 4.0 x16 - Passive CoolerNVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive CoolingNVIDIA® L40 ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® H100 GPU Computing Accelerator - 80GB HBM2e - PCIe 5.0 x16 - Passive Cooling (w/o CEC)NVIDIA® RTX A1000 - 8GB GDDR6 - PCIe 4.0 x8 - Active Cooling (4x mDP)
ActionSelectSelectSelectSelectSelect
Main Specifications
Product Series Nvidia A30Nvidia L4Nvidia L40Nvidia H100
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Core Clock Speed 795 MHz Base | 2040 MHz Boost
Host Interface PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 5.0 x16PCI Express 4.0 x8
GPU Architecture AmpereAda LovelaceAda LovelaceHopper
Product Type Workstation
Product Line NVIDIA Professional Graphics
Memory Technology GDDR6
Memory Capacity 8 GB
Max Displays 4 Displays
Detailed Specifications
Streaming Processor Cores 2307 CUDA Cores
NVIDIA Tensor Cores 72
NVIDIA RT Cores 18
PCIe x16 Interconnect Bandwidth PCIe Gen5: 128GB/s
Memory Clock Speed 6251 MHz
Memory Interface 192-bit128-bit
Max Memory Size 24 GB HBM224 GB48 GB GDDR6 with ECC80 GB
Max Memory Bandwidth 933 GB/s300 GB/s2.0TB/s
ECC Protection On by Default
Peak FP64 5.2 teraFLOPS24 teraFLOPS
Peak FP64 Tensor Core 10.3 teraFLOPS48 teraFLOPS
INT8 Tensor Core 330 TOPS | 661 TOPS485 TOPS | Sparsity3,200 TOPS
TF32 Tensor Core 82 teraFLOPS | 165 teraFLOPS120 TFLOPS | Sparsity800 teraFLOPS
FP32 10.3 teraFLOPS30.3 TFLOPS48 teraFLOPS
Peak BFLOAT16 Tensor Core 165 teraFLOPS | 330 teraFLOPS242 TFLOPS | Sparsity1,600 teraFLOPS
Peak FP16 Tensor Core 165 teraFLOPS | 330 teraFLOPS242 TFLOPS | Sparsity1,600 teraFLOPS
Peak FP8 Tensor Core 485 TFLOPS | Sparsity3,200 teraFLOPS
Peak INT4 Tensor Core 661 TOPS | 1321 TOPS
Total NVLink Bandwidth Third-gen NVLINK: 200GB/s600GB/s
Multi-Instance GPUs Up to 7 MIGS @ 10GB each
Tensor Performance 13.2 TFLOPS
vGPU Software Support NVIDIA vPC/vApps, NVIDIA RTX Virtual Workstation (vWS)
NVENC | NVDEC 2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode3x | 3x (Includes AV1 Encode & Decode)
Secure Boot with Root of Trust YesYes
NEBS Ready Yes | Level 3Yes / Level 3
Transistor Count 8.7 Billion
DisplayPort Connectors None | vGPU Only4x DP 1.4a
Cooling PassivePassivePassive
Dual Slot Dual-slotNoYesYes
Dimensions 4.4" (H) x 10.5" (L)2.7" H x 6.4" L
Form Factor 6.61” L x 2.71” H (Low-profile)PCIePCIe
Lithography 8N | NVIDIA Custom Process
Supplementary Power Connectors 1x 8-pin CPU (EPS12V)1x 16-pin PCIe CEM51x 16-pin PCIe CEM5
Max Graphics Card Power (W) 165W72W300W350W50W
Processor Ampere
Memory Bandwidth 192 GB/sec
Peak Single Precision FP32 Performance 6.74 TFLOPS
NVLink Interconnect Not Supported
Mini DisplayPort Output 4x mDisplayPort 1.4a
Thermal Solution Active Fan
Slot Height Single Slot
ActionSelectSelectSelectSelectSelect