ProductNVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® H100 NVL GPU Computing Accelerator - 94GB HBM3 - PCIe 5.0 x16 - Passive CoolingNVIDIA® H200 NVL GPU Computing Accelerator - 141GB HBM3e - PCIe 5.0 x16 - Passive CoolingNVIDIA® RTX PRO 6000 Blackwell Server Edition - 96GB GDDR7 ECC - PCIe 5.0 x16 - Passive Cooling (4xDP)
ActionSelectSelectSelectSelect
Main Specifications
Product Series Nvidia L40SNvidia H100 NVLNvidia H200
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Host Interface PCI Express 4.0 x16PCI Express 5.0 x16PCI Express 5.0 x16PCI Express 5.0 x16
GPU Architecture Ada LovelaceHopperHopper
Product Type Server
Product Line NVIDIA Professional Graphics
Memory Technology GDDR7
Memory Capacity 96 GB with ECC
Max Displays 4 Displays
Detailed Specifications
Streaming Processor Cores 18,17624,064 CUDA Parallel Processing Cores
NVIDIA Tensor Cores 568 | Gen 4752 (5th Gen)
NVIDIA RT Cores 142 | Gen 3188 (4th Gen)
PCIe x16 Interconnect Bandwidth PCIe Gen5: 128GB/s
Memory Interface 512-bit
Max Memory Size 48GB GDDR6 with ECC94 GB141 GB
Max Memory Bandwidth 864 GB/s7.8TB/s4.8TB/s
Peak FP64 68 teraFLOPs30 TFLOPS
Peak FP64 Tensor Core 134 teraFLOPs60 TFLOPS
INT8 Tensor Core 733 teraFLOPS7,916 TOPS3,341 TFLOPS
TF32 Tensor Core 183 teraFLOPS1,979 teraFLOPs835 TFLOPS
FP32 91.6 teraFLOPS134 teraFLOPs60 TFLOPS
Peak BFLOAT16 Tensor Core 362.05 teraFLOPS3,958 teraFLOPs1,671 TFLOPS
Peak FP16 Tensor Core 362.05 teraFLOPS3,958 teraFLOPs1,671 TFLOPS
Peak FP8 Tensor Core 733 teraFLOPS7,916 teraFLOPs3,341 TFLOPS
Peak INT4 Tensor Core 733 teraFLOPS
Total NVLink Bandwidth Not supported600GB/s
Multi-Instance GPUs No
NVENC | NVDEC 3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust Yes
NEBS Ready Level 3
DisplayPort Connectors 4x DisplayPort 1.4a
Cooling PassivePassivePassive
Dual Slot Yes
Dimensions 4.4" (H) x 10.5" (L)4.4” H x 10.5” L, FHFL Dual Slot
Form Factor PCIeDual-slot air-cooled
Lithography 4N NVIDIA Custom Process
Supplementary Power Connectors 1x 16-pin1x PCIe CEM5 16-pin
Max Graphics Card Power (W) 350W400WUp to 600W (configurable)400 W – 600 W (configurable)
Processor NVIDIA Blackwell Architecture
Memory Bandwidth Up to 1.6 TB/s
Minimum Recommended Power, Single Card (W) 800
Minimum Recommended Power, 2-Way (W) 1600
Minimum Recommended Power, 3-Way (W) 2000
Minimum Recommended Power, 4-Way (W) 2400
Thermal Solution Passive
Slot Height 2-Slot
ActionSelectSelectSelectSelect