ProductNVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® H100 NVL GPU Computing Accelerator - 94GB HBM3 - PCIe 5.0 x16 - Passive Cooling
ActionSelectSelect
Main Specifications
Product Series Nvidia L40SNvidia H100 NVL
Core Type NVIDIA TENSORNVIDIA TENSOR
Host Interface PCI Express 4.0 x16PCI Express 5.0 x16
GPU Architecture Ada LovelaceHopper
Detailed Specifications
Streaming Processor Cores 18,176
NVIDIA Tensor Cores 568 | Gen 4
NVIDIA RT Cores 142 | Gen 3
PCIe x16 Interconnect Bandwidth PCIe Gen5: 128GB/s
Max Memory Size 48GB GDDR6 with ECC94 GB
Max Memory Bandwidth 864 GB/s7.8TB/s
Peak FP64 68 teraFLOPs
Peak FP64 Tensor Core 134 teraFLOPs
INT8 Tensor Core 733 teraFLOPS7,916 TOPS
TF32 Tensor Core 183 teraFLOPS1,979 teraFLOPs
FP32 91.6 teraFLOPS134 teraFLOPs
Peak BFLOAT16 Tensor Core 362.05 teraFLOPS3,958 teraFLOPs
Peak FP16 Tensor Core 362.05 teraFLOPS3,958 teraFLOPs
Peak FP8 Tensor Core 733 teraFLOPS7,916 teraFLOPs
Peak INT4 Tensor Core 733 teraFLOPS
Total NVLink Bandwidth Not supported600GB/s
Multi-Instance GPUs No
NVENC | NVDEC 3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust Yes
NEBS Ready Level 3
DisplayPort Connectors 4x DisplayPort 1.4a
Cooling PassivePassive
Dual Slot Yes
Dimensions 4.4" (H) x 10.5" (L)
Form Factor PCIe
Supplementary Power Connectors 1x 16-pin
Max Graphics Card Power (W) 350W400W
ActionSelectSelect