Product	NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive Cooling	NVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling	NVIDIA® H100 NVL GPU Computing Accelerator - 94GB HBM3 - PCIe 5.0 x16 - Passive Cooling	NVIDIA® H200 NVL GPU Computing Accelerator - 141GB HBM3e - PCIe 5.0 x16 - Passive Cooling	NVIDIA® RTX PRO 6000 Blackwell Server Edition - 96GB GDDR7 ECC - PCIe 5.0 x16 - Passive Cooling (4xDP)
Action	Select	Select	Select	Select	Select
Main Specifications
Product Series	Nvidia L4	Nvidia L40S	Nvidia H100 NVL	Nvidia H200
Core Type	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR
Core Clock Speed	795 MHz Base | 2040 MHz Boost
Host Interface	PCI Express 4.0 x16	PCI Express 4.0 x16	PCI Express 5.0 x16	PCI Express 5.0 x16	PCI Express 5.0 x16
GPU Architecture	Ada Lovelace	Ada Lovelace	Hopper	Hopper
Product Type					Server
Product Line					NVIDIA Professional Graphics
Memory Technology					GDDR7
Memory Capacity					96 GB with ECC
Max Displays					4 Displays
Detailed Specifications
Streaming Processor Cores		18,176			24,064 CUDA Parallel Processing Cores
NVIDIA Tensor Cores		568 | Gen 4			752 (5th Gen)
NVIDIA RT Cores		142 | Gen 3			188 (4th Gen)
PCIe x16 Interconnect Bandwidth			PCIe Gen5: 128GB/s
Memory Clock Speed	6251 MHz
Memory Interface	192-bit				512-bit
Max Memory Size	24 GB	48GB GDDR6 with ECC	94 GB	141 GB
Max Memory Bandwidth	300 GB/s	864 GB/s	7.8TB/s	4.8TB/s
ECC Protection	On by Default
Peak FP64			68 teraFLOPs	30 TFLOPS
Peak FP64 Tensor Core			134 teraFLOPs	60 TFLOPS
INT8 Tensor Core	485 TOPS | Sparsity	733 teraFLOPS	7,916 TOPS	3,341 TFLOPS
TF32 Tensor Core	120 TFLOPS | Sparsity	183 teraFLOPS	1,979 teraFLOPs	835 TFLOPS
FP32	30.3 TFLOPS	91.6 teraFLOPS	134 teraFLOPs	60 TFLOPS
Peak BFLOAT16 Tensor Core	242 TFLOPS | Sparsity	362.05 teraFLOPS	3,958 teraFLOPs	1,671 TFLOPS
Peak FP16 Tensor Core	242 TFLOPS | Sparsity	362.05 teraFLOPS	3,958 teraFLOPs	1,671 TFLOPS
Peak FP8 Tensor Core	485 TFLOPS | Sparsity	733 teraFLOPS	7,916 teraFLOPs	3,341 TFLOPS
Peak INT4 Tensor Core		733 teraFLOPS
Total NVLink Bandwidth		Not supported	600GB/s
Multi-Instance GPUs		No
NVENC | NVDEC	2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode	3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust	Yes	Yes
NEBS Ready	Yes | Level 3	Level 3
DisplayPort Connectors	None | vGPU Only	4x DisplayPort 1.4a
Cooling	Passive	Passive	Passive	Passive
Dual Slot	No		Yes
Dimensions		4.4" (H) x 10.5" (L)			4.4” H x 10.5” L, FHFL Dual Slot
Form Factor	6.61” L x 2.71” H (Low-profile)		PCIe	Dual-slot air-cooled
Lithography					4N NVIDIA Custom Process
Supplementary Power Connectors		1x 16-pin			1x PCIe CEM5 16-pin
Max Graphics Card Power (W)	72W	350W	400W	Up to 600W (configurable)	400 W – 600 W (configurable)
Processor					NVIDIA Blackwell Architecture
Memory Bandwidth					Up to 1.6 TB/s
Minimum Recommended Power, Single Card (W)					800
Minimum Recommended Power, 2-Way (W)					1600
Minimum Recommended Power, 3-Way (W)					2000
Minimum Recommended Power, 4-Way (W)					2400
Thermal Solution					Passive
Slot Height					2-Slot
Action	Select	Select	Select	Select	Select