ProductNVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive CoolingNVIDIA® L40 ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® H100 NVL GPU Computing Accelerator - 94GB HBM3 - PCIe 5.0 x16 - Passive Cooling
ActionSelectSelectSelectSelect
Main Specifications
Product Series Nvidia L4Nvidia L40Nvidia L40SNvidia H100 NVL
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Core Clock Speed 795 MHz Base | 2040 MHz Boost
Host Interface PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 5.0 x16
GPU Architecture Ada LovelaceAda LovelaceAda LovelaceHopper
Detailed Specifications
Streaming Processor Cores 18,176
NVIDIA Tensor Cores 568 | Gen 4
NVIDIA RT Cores 142 | Gen 3
PCIe x16 Interconnect Bandwidth PCIe Gen5: 128GB/s
Memory Clock Speed 6251 MHz
Memory Interface 192-bit
Max Memory Size 24 GB48 GB GDDR6 with ECC48GB GDDR6 with ECC94 GB
Max Memory Bandwidth 300 GB/s864 GB/s7.8TB/s
Peak FP64 68 teraFLOPs
Peak FP64 Tensor Core 134 teraFLOPs
INT8 Tensor Core 485 TOPS | Sparsity733 teraFLOPS7,916 TOPS
TF32 Tensor Core 120 TFLOPS | Sparsity183 teraFLOPS1,979 teraFLOPs
FP32 30.3 TFLOPS91.6 teraFLOPS134 teraFLOPs
Peak BFLOAT16 Tensor Core 242 TFLOPS | Sparsity362.05 teraFLOPS3,958 teraFLOPs
Peak FP16 Tensor Core 242 TFLOPS | Sparsity362.05 teraFLOPS3,958 teraFLOPs
Peak FP8 Tensor Core 485 TFLOPS | Sparsity733 teraFLOPS7,916 teraFLOPs
Peak INT4 Tensor Core 733 teraFLOPS
Total NVLink Bandwidth Not supported600GB/s
Multi-Instance GPUs No
vGPU Software Support NVIDIA vPC/vApps, NVIDIA RTX Virtual Workstation (vWS)
NVENC | NVDEC 2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode3x | 3x (Includes AV1 Encode & Decode)3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust YesYesYes
NEBS Ready Yes | Level 3Yes / Level 3Level 3
ECC Protection On by Default
DisplayPort Connectors None | vGPU Only4x DP 1.4a4x DisplayPort 1.4a
Cooling PassivePassivePassivePassive
Dual Slot NoYesYes
Dimensions 4.4" (H) x 10.5" (L)4.4" (H) x 10.5" (L)
Form Factor 6.61” L x 2.71” H (Low-profile)PCIePCIe
Supplementary Power Connectors 1x 16-pin PCIe CEM51x 16-pin
Max Graphics Card Power (W) 72W300W350W400W
ActionSelectSelectSelectSelect