Product	NVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling	NVIDIA® H100 NVL GPU Computing Accelerator - 94GB HBM3 - PCIe 5.0 x16 - Passive Cooling	NVIDIA® H200 NVL GPU Computing Accelerator - 141GB HBM3e - PCIe 5.0 x16 - Passive Cooling
Action	Select	Select	Select
Main Specifications
Product Series	Nvidia L40S	Nvidia H100 NVL	Nvidia H200
Core Type	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR
Host Interface	PCI Express 4.0 x16	PCI Express 5.0 x16	PCI Express 5.0 x16
GPU Architecture	Ada Lovelace	Hopper	Hopper
Detailed Specifications
Streaming Processor Cores	18,176
NVIDIA Tensor Cores	568 | Gen 4
NVIDIA RT Cores	142 | Gen 3
PCIe x16 Interconnect Bandwidth		PCIe Gen5: 128GB/s
Max Memory Size	48GB GDDR6 with ECC	94 GB	141 GB
Max Memory Bandwidth	864 GB/s	7.8TB/s	4.8TB/s
Peak FP64		68 teraFLOPs	30 TFLOPS
Peak FP64 Tensor Core		134 teraFLOPs	60 TFLOPS
INT8 Tensor Core	733 teraFLOPS	7,916 TOPS	3,341 TFLOPS
TF32 Tensor Core	183 teraFLOPS	1,979 teraFLOPs	835 TFLOPS
FP32	91.6 teraFLOPS	134 teraFLOPs	60 TFLOPS
Peak BFLOAT16 Tensor Core	362.05 teraFLOPS	3,958 teraFLOPs	1,671 TFLOPS
Peak FP16 Tensor Core	362.05 teraFLOPS	3,958 teraFLOPs	1,671 TFLOPS
Peak FP8 Tensor Core	733 teraFLOPS	7,916 teraFLOPs	3,341 TFLOPS
Peak INT4 Tensor Core	733 teraFLOPS
Total NVLink Bandwidth	Not supported	600GB/s
Multi-Instance GPUs	No
NVENC | NVDEC	3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust	Yes
NEBS Ready	Level 3
DisplayPort Connectors	4x DisplayPort 1.4a
Cooling	Passive	Passive	Passive
Dual Slot		Yes
Dimensions	4.4" (H) x 10.5" (L)
Form Factor		PCIe	Dual-slot air-cooled
Supplementary Power Connectors	1x 16-pin
Max Graphics Card Power (W)	350W	400W	Up to 600W (configurable)
Action	Select	Select	Select