Product	NVIDIA® A30 GPU Computing Accelerator - 24GB HBM2 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)	NVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling	NVIDIA® H100 GPU Computing Accelerator - 80GB HBM2e - PCIe 5.0 x16 - Passive Cooling (w/o CEC)
Action	Select	Select	Select
Main Specifications
Product Series	Nvidia A30	Nvidia L40S	Nvidia H100
Core Type	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR
Host Interface	PCI Express 4.0 x16	PCI Express 4.0 x16	PCI Express 5.0 x16
GPU Architecture	Ampere	Ada Lovelace	Hopper
Detailed Specifications
Streaming Processor Cores		18,176
NVIDIA Tensor Cores		568 | Gen 4
NVIDIA RT Cores		142 | Gen 3
PCIe x16 Interconnect Bandwidth			PCIe Gen5: 128GB/s
Max Memory Size	24 GB HBM2	48GB GDDR6 with ECC	80 GB
Max Memory Bandwidth	933 GB/s	864 GB/s	2.0TB/s
Peak FP64	5.2 teraFLOPS		24 teraFLOPS
Peak FP64 Tensor Core	10.3 teraFLOPS		48 teraFLOPS
INT8 Tensor Core	330 TOPS | 661 TOPS	733 teraFLOPS	3,200 TOPS
TF32 Tensor Core	82 teraFLOPS | 165 teraFLOPS	183 teraFLOPS	800 teraFLOPS
FP32	10.3 teraFLOPS	91.6 teraFLOPS	48 teraFLOPS
Peak BFLOAT16 Tensor Core	165 teraFLOPS | 330 teraFLOPS	362.05 teraFLOPS	1,600 teraFLOPS
Peak FP16 Tensor Core	165 teraFLOPS | 330 teraFLOPS	362.05 teraFLOPS	1,600 teraFLOPS
Peak FP8 Tensor Core		733 teraFLOPS	3,200 teraFLOPS
Peak INT4 Tensor Core	661 TOPS | 1321 TOPS	733 teraFLOPS
Total NVLink Bandwidth	Third-gen NVLINK: 200GB/s	Not supported	600GB/s
Multi-Instance GPUs		No	Up to 7 MIGS @ 10GB each
NVENC | NVDEC		3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust		Yes
NEBS Ready		Level 3
DisplayPort Connectors		4x DisplayPort 1.4a
Cooling		Passive	Passive
Dual Slot	Dual-slot		Yes
Dimensions		4.4" (H) x 10.5" (L)
Form Factor			PCIe
Supplementary Power Connectors	1x 8-pin CPU (EPS12V)	1x 16-pin	1x 16-pin PCIe CEM5
Max Graphics Card Power (W)	165W	350W	350W
Action	Select	Select	Select