ProductIntegrated Video (Included with Motherboard)NVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® H100 NVL GPU Computing Accelerator - 94GB HBM3 - PCIe 5.0 x16 - Passive CoolingNVIDIA® H200 NVL GPU Computing Accelerator - 141GB HBM3e - PCIe 5.0 x16 - Passive CoolingNVIDIA® RTX 6000 Ada Generation - 48GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX PRO 6000 Blackwell Server Edition - 96GB GDDR7 ECC - PCIe 5.0 x16 - Passive Cooling (4xDP)
ActionSelectSelectSelectSelectSelectSelect
Main Specifications
Product Series Nvidia L40SNvidia H100 NVLNvidia H200
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Host Interface PCI Express 4.0 x16PCI Express 5.0 x16PCI Express 5.0 x16PCI Express 4.0 x16PCI Express 5.0 x16
GPU Architecture Ada LovelaceHopperHopper
Product Type WorkstationServer
Product Line NVIDIA Professional GraphicsNVIDIA Professional Graphics
Memory Technology GDDR6GDDR7
Memory Capacity 48 GB with ECC96 GB with ECC
Max Displays 4 Displays4 Displays
Detailed Specifications
Streaming Processor Cores 18,17618,17624,064 CUDA Parallel Processing Cores
NVIDIA Tensor Cores 568 | Gen 4568752 (5th Gen)
NVIDIA RT Cores 142 | Gen 3142188 (4th Gen)
PCIe x16 Interconnect Bandwidth PCIe Gen5: 128GB/s
Memory Interface 384-bit512-bit
Max Memory Size 48GB GDDR6 with ECC94 GB141 GB
Max Memory Bandwidth 864 GB/s7.8TB/s4.8TB/s
Peak FP64 68 teraFLOPs30 TFLOPS
Peak FP64 Tensor Core 134 teraFLOPs60 TFLOPS
INT8 Tensor Core 733 teraFLOPS7,916 TOPS3,341 TFLOPS
TF32 Tensor Core 183 teraFLOPS1,979 teraFLOPs835 TFLOPS
FP32 91.6 teraFLOPS134 teraFLOPs60 TFLOPS
Peak BFLOAT16 Tensor Core 362.05 teraFLOPS3,958 teraFLOPs1,671 TFLOPS
Peak FP16 Tensor Core 362.05 teraFLOPS3,958 teraFLOPs1,671 TFLOPS
Peak FP8 Tensor Core 733 teraFLOPS7,916 teraFLOPs3,341 TFLOPS
Peak INT4 Tensor Core 733 teraFLOPS
Total NVLink Bandwidth Not supported600GB/s
Multi-Instance GPUs No
Tensor Performance 1457.0 TFLOPS
NVENC | NVDEC 3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust Yes
NEBS Ready Level 3
Transistor Count 76.3 billion
DisplayPort Connectors 4x DisplayPort 1.4a
Cooling PassivePassivePassive
Dual Slot Yes
Dimensions 4.4" (H) x 10.5" (L)4.4" H x 10.5" L4.4” H x 10.5” L, FHFL Dual Slot
Form Factor PCIeDual-slot air-cooled
Lithography 4 nm NVIDIA Custom Process4N NVIDIA Custom Process
Supplementary Power Connectors 1x 16-pin1x PCIe CEM5 16-pin1x PCIe CEM5 16-pin
Max Graphics Card Power (W) 350W400WUp to 600W (configurable)300W400 W – 600 W (configurable)
Processor NVIDIA Ada LovelaceNVIDIA Blackwell Architecture
Memory Bandwidth 960 GB/sUp to 1.6 TB/s
Peak Single Precision FP32 Performance 91.1 TFLOPS
RT Core Performance 210.6 TFLOPS
DisplayPort Output 4x DP 1.4a
Minimum Recommended Power, Single Card (W) 600800
Minimum Recommended Power, 2-Way (W) 7501600
Minimum Recommended Power, 3-Way (W) 8502000
Minimum Recommended Power, 4-Way (W) 10002400
Thermal Solution Blower Active FanPassive
Slot Height 2-Slot2-Slot
ActionSelectSelectSelectSelectSelectSelect