Product	NVIDIA® A100 GPU Computing Accelerator - 80GB HBM2 - PCIe 4.0 x16 - Passive Cooling	NVIDIA® L40 ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling	NVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling	NVIDIA® H200 NVL GPU - 141GB HBM3e - PCIe 5.0 x16 - Passive Cooling - 600W	NVIDIA® RTX 4000 SFF Ada Generation - 20GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4x mDP)	NVIDIA® RTX 6000 Ada Generation - 48GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)
Action	Select	Select	Select	Select	Select	Select
Main Specifications
Product Series	Nvidia A100	Nvidia L40	Nvidia L40S	Nvidia H200
Core Type	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR
Host Interface	PCI Express 4.0 x16	PCI Express 4.0 x16	PCI Express 4.0 x16	PCI Express 5.0 x16	PCI Express 4.0 x16	PCI Express 4.0 x16
GPU Architecture	Ampere	Ada Lovelace	Ada Lovelace	Hopper
Product Type					Workstation	Workstation
Product Line					NVIDIA Professional Graphics	NVIDIA Professional Graphics
Memory Technology					GDDR6	GDDR6
Memory Capacity					20 GB GDDR6 ECC	48 GB with ECC
Max Displays						4 Displays
Detailed Specifications
Streaming Processor Cores			18,176		6144 CUDA Cores	18,176
NVIDIA Tensor Cores			568 | Gen 4		192 | Gen 4	568
NVIDIA RT Cores			142 | Gen 3		48 | Gen 3	142
PCIe x16 Interconnect Bandwidth	PCIe Gen4 64 GB/s
Memory Interface					160-bit	384-bit
Max Memory Size	80 GB	48 GB GDDR6 with ECC	48GB GDDR6 with ECC	141 GB
Max Memory Bandwidth	1,935 GB/s		864 GB/s	4.8TB/s
Peak FP64	9.7 TFLOPS			30 TFLOPS
Peak FP64 Tensor Core	19.5 TFLOPS			60 TFLOPS
INT8 Tensor Core	624 TOPS		733 teraFLOPS	3,341 TFLOPS
TF32 Tensor Core	156 TFLOPS		183 teraFLOPS	835 TFLOPS
FP32	19.5 TFLOPS		91.6 teraFLOPS	60 TFLOPS
Peak BFLOAT16 Tensor Core	312 TFLOPS		362.05 teraFLOPS	1,671 TFLOPS
Peak FP16 Tensor Core	312 TFLOPS		362.05 teraFLOPS	1,671 TFLOPS
Peak FP8 Tensor Core			733 teraFLOPS	3,341 TFLOPS
Peak INT4 Tensor Core			733 teraFLOPS
Total NVLink Bandwidth	600 GB/s (via NVLink Bridge for up to 2-GPUs)		Not supported
Multi-Instance GPUs	7 MIGs at 10GB		No
Tensor Performance					306.8 TFLOPS	1457.0 TFLOPS
NVIDIA CUDA™ Technology					Yes
vGPU Software Support		NVIDIA vPC/vApps, NVIDIA RTX Virtual Workstation (vWS)
NVENC | NVDEC		3x | 3x (Includes AV1 Encode & Decode)	3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust		Yes	Yes
NEBS Ready		Yes / Level 3	Level 3
Transistor Count					35.8 Billion	76.3 billion
DisplayPort Connectors		4x DP 1.4a	4x DisplayPort 1.4a
Cooling	Passive	Passive	Passive	Passive
Dual Slot	Yes	Yes
Dimensions		4.4" (H) x 10.5" (L)	4.4" (H) x 10.5" (L)		2.7” H x 6.6”L	4.4" H x 10.5" L
Form Factor		PCIe		Dual-slot air-cooled
Lithography						4 nm NVIDIA Custom Process
Supplementary Power Connectors	1x 8-pin CPU (EPS12V)	1x 16-pin PCIe CEM5	1x 16-pin		No Auxiliary Power Required	1x PCIe CEM5 16-pin
Max Graphics Card Power (W)	300W	300W	350W	Up to 600W (configurable)	70W	300W
Processor					NVIDIA Ada Lovelace	NVIDIA Ada Lovelace
Memory Bandwidth					320 GB/s	960 GB/s
Peak Single Precision FP32 Performance					19.2 TFLOPS	91.1 TFLOPS
RT Core Performance					44.3 TFLOPS	210.6 TFLOPS
VR Ready					Yes
DisplayPort Output						4x DP 1.4a
Mini DisplayPort Output					4x mDP 1.4a
Minimum Recommended Power, Single Card (W)						600
Minimum Recommended Power, 2-Way (W)						750
Minimum Recommended Power, 3-Way (W)						850
Minimum Recommended Power, 4-Way (W)						1000
Thermal Solution					Active Heatsink	Blower Active Fan
Slot Height					Low Profile Dual Slot	2-Slot
Action	Select	Select	Select	Select	Select	Select