Product	NVIDIA® A2 GPU Computing Accelerator - 16GB GDDR6 - PCIe 4.0 x8 - Passive Cooler (w/o CEC)	NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive Cooling	NVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling	NVIDIA® H100 GPU Computing Accelerator - 80GB HBM2e - PCIe 5.0 x16 - Passive Cooling (w/o CEC)	NVIDIA® RTX 6000 Ada Generation - 48GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)
Action	Select	Select	Select	Select	Select
Main Specifications
Product Series	Nvidia A2	Nvidia L4	Nvidia L40S	Nvidia H100
Core Type	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR
Core Clock Speed	1440 MHz (1770 MHz Boost Clock)	795 MHz Base | 2040 MHz Boost
Host Interface	PCI Express 4.0 x8	PCI Express 4.0 x16	PCI Express 4.0 x16	PCI Express 5.0 x16	PCI Express 4.0 x16
GPU Architecture	Ampere	Ada Lovelace	Ada Lovelace	Hopper
Product Type					Workstation
Product Line					NVIDIA Professional Graphics
Memory Technology					GDDR6
Memory Capacity					48 GB with ECC
Max Displays					4 Displays
Detailed Specifications
Streaming Processor Cores	1280 CUDA Cores		18,176		18,176
NVIDIA Tensor Cores	40 | Gen 3		568 | Gen 4		568
NVIDIA RT Cores	10 | Gen 2		142 | Gen 3		142
PCIe x16 Interconnect Bandwidth				PCIe Gen5: 128GB/s
Memory Clock Speed	6251 MHz	6251 MHz
Memory Interface	128-bit	192-bit			384-bit
Max Memory Size	16 GB GDDR6 ECC	24 GB	48GB GDDR6 with ECC	80 GB
Max Memory Bandwidth	200 GB/s	300 GB/s	864 GB/s	2.0TB/s
ECC Protection	On by Default	On by Default
Peak FP64				24 teraFLOPS
Peak FP64 Tensor Core				48 teraFLOPS
INT8 Tensor Core		485 TOPS | Sparsity	733 teraFLOPS	3,200 TOPS
TF32 Tensor Core	9 TFLOPS | 18 TFLOPS Sparsity	120 TFLOPS | Sparsity	183 teraFLOPS	800 teraFLOPS
FP32	4.5 TFLOPS	30.3 TFLOPS	91.6 teraFLOPS	48 teraFLOPS
Peak BFLOAT16 Tensor Core		242 TFLOPS | Sparsity	362.05 teraFLOPS	1,600 teraFLOPS
Peak FP16 Tensor Core	18 TFLOPS | 36 TFLOPS Sparsity	242 TFLOPS | Sparsity	362.05 teraFLOPS	1,600 teraFLOPS
Peak FP8 Tensor Core		485 TFLOPS | Sparsity	733 teraFLOPS	3,200 teraFLOPS
Peak INT4 Tensor Core			733 teraFLOPS
Total NVLink Bandwidth			Not supported	600GB/s
Multi-Instance GPUs			No	Up to 7 MIGS @ 10GB each
Tensor Performance					1457.0 TFLOPS
NVIDIA CUDA™ Technology	11.1 or later
NVENC | NVDEC		2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode	3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust		Yes	Yes
NEBS Ready		Yes | Level 3	Level 3
Peak INT4 Performance	72 TOPS | 144 TOPS Sparsity
Peak INT8 Performance	36 TOPS | 72 TOPS Sparsity
Transistor Count					76.3 billion
DisplayPort Connectors		None | vGPU Only	4x DisplayPort 1.4a
Cooling	Passive	Passive	Passive	Passive
Dual Slot	Single-slot	No		Yes
Dimensions	6.61” L x 2.71” H		4.4" (H) x 10.5" (L)		4.4" H x 10.5" L
Form Factor	Low-Profile PCIe	6.61” L x 2.71” H (Low-profile)		PCIe
Lithography					4 nm NVIDIA Custom Process
Supplementary Power Connectors			1x 16-pin	1x 16-pin PCIe CEM5	1x PCIe CEM5 16-pin
Max Graphics Card Power (W)	40-60 W | Configurable	72W	350W	350W	300W
Processor					NVIDIA Ada Lovelace
Memory Bandwidth					960 GB/s
Peak Single Precision FP32 Performance					91.1 TFLOPS
RT Core Performance					210.6 TFLOPS
DisplayPort Output					4x DP 1.4a
Minimum Recommended Power, Single Card (W)					600
Minimum Recommended Power, 2-Way (W)					750
Minimum Recommended Power, 3-Way (W)					850
Minimum Recommended Power, 4-Way (W)					1000
Thermal Solution					Blower Active Fan
Slot Height					2-Slot
Action	Select	Select	Select	Select	Select