ProductNVIDIA® L40 ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® H100 NVL GPU Computing Accelerator - 94GB HBM3 - PCIe 5.0 x16 - Passive Cooling
ActionSelectSelectSelect
Main Specifications
Product Series Nvidia L40Nvidia L40SNvidia H100 NVL
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Host Interface PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 5.0 x16
GPU Architecture Ada LovelaceAda LovelaceHopper
Detailed Specifications
Streaming Processor Cores 18,176
NVIDIA Tensor Cores 568 | Gen 4
NVIDIA RT Cores 142 | Gen 3
PCIe x16 Interconnect Bandwidth PCIe Gen5: 128GB/s
Max Memory Size 48 GB GDDR6 with ECC48GB GDDR6 with ECC94 GB
Max Memory Bandwidth 864 GB/s7.8TB/s
Peak FP64 68 teraFLOPs
Peak FP64 Tensor Core 134 teraFLOPs
INT8 Tensor Core 733 teraFLOPS7,916 TOPS
TF32 Tensor Core 183 teraFLOPS1,979 teraFLOPs
FP32 91.6 teraFLOPS134 teraFLOPs
Peak BFLOAT16 Tensor Core 362.05 teraFLOPS3,958 teraFLOPs
Peak FP16 Tensor Core 362.05 teraFLOPS3,958 teraFLOPs
Peak FP8 Tensor Core 733 teraFLOPS7,916 teraFLOPs
Peak INT4 Tensor Core 733 teraFLOPS
Total NVLink Bandwidth Not supported600GB/s
Multi-Instance GPUs No
vGPU Software Support NVIDIA vPC/vApps, NVIDIA RTX Virtual Workstation (vWS)
NVENC | NVDEC 3x | 3x (Includes AV1 Encode & Decode)3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust YesYes
NEBS Ready Yes / Level 3Level 3
DisplayPort Connectors 4x DP 1.4a4x DisplayPort 1.4a
Cooling PassivePassivePassive
Dual Slot YesYes
Dimensions 4.4" (H) x 10.5" (L)4.4" (H) x 10.5" (L)
Form Factor PCIePCIe
Supplementary Power Connectors 1x 16-pin PCIe CEM51x 16-pin
Max Graphics Card Power (W) 300W350W400W
ActionSelectSelectSelect