Product	NVIDIA® A10 GPU Computing Accelerator - 24GB GDDR6 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)	NVIDIA® A16 GPU Computing Accelerator - 64GB (4x 16GB) GDDR6 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)	NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive Cooling	NVIDIA® L40 ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling	NVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling	NVIDIA® H100 NVL GPU Computing Accelerator - 94GB HBM3 - PCIe 5.0 x16 - Passive Cooling	NVIDIA® H200 NVL GPU Computing Accelerator - 141GB HBM3e - PCIe 5.0 x16 - Passive Cooling	NVIDIA® RTX PRO 6000 Blackwell Server Edition - 96GB GDDR7 ECC - PCIe 5.0 x16 - Passive Cooling (4xDP)
Action	Select	Select	Select	Select	Select	Select	Select	Select
Main Specifications
Product Series	Nvidia A10	Nvidia A16	Nvidia L4	Nvidia L40	Nvidia L40S	Nvidia H100 NVL	Nvidia H200
Core Type	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR
Core Clock Speed	885 MHz (1695 MHz Boost Clock)		795 MHz Base | 2040 MHz Boost
Host Interface	PCI Express 4.0 x16 64GB/s	PCI Express 4.0 x16	PCI Express 4.0 x16	PCI Express 4.0 x16	PCI Express 4.0 x16	PCI Express 5.0 x16	PCI Express 5.0 x16	PCI Express 5.0 x16
GPU Architecture	Ampere	Ampere	Ada Lovelace	Ada Lovelace	Ada Lovelace	Hopper	Hopper
Product Type								Server
Product Line								NVIDIA Professional Graphics
Memory Technology								GDDR7
Memory Capacity								96 GB with ECC
Max Displays								4 Displays
Detailed Specifications
Streaming Processor Cores					18,176			24,064 CUDA Parallel Processing Cores
NVIDIA Tensor Cores					568 | Gen 4			752 (5th Gen)
NVIDIA RT Cores	72 RT Cores				142 | Gen 3			188 (4th Gen)
PCIe x16 Interconnect Bandwidth						PCIe Gen5: 128GB/s
Memory Clock Speed	1563 MHz		6251 MHz
Memory Interface			192-bit					512-bit
Max Memory Size	24 GB GDDR6	4x 16GB GDDR6 with error-correcting code (ECC)	24 GB	48 GB GDDR6 with ECC	48GB GDDR6 with ECC	94 GB	141 GB
Max Memory Bandwidth	600 GB/s	4x 232GB/s	300 GB/s		864 GB/s	7.8TB/s	4.8TB/s
ECC Protection			On by Default
Peak FP64						68 teraFLOPs	30 TFLOPS
Peak FP64 Tensor Core						134 teraFLOPs	60 TFLOPS
INT8 Tensor Core	250 TOPS | 500 TOPS		485 TOPS | Sparsity		733 teraFLOPS	7,916 TOPS	3,341 TFLOPS
TF32 Tensor Core	62.5 teraFLOPS | 125 teraFLOPS		120 TFLOPS | Sparsity		183 teraFLOPS	1,979 teraFLOPs	835 TFLOPS
FP32	31.2 teraFLOPS		30.3 TFLOPS		91.6 teraFLOPS	134 teraFLOPs	60 TFLOPS
Peak BFLOAT16 Tensor Core	125 teraFLOPS | 250 teraFLOPS		242 TFLOPS | Sparsity		362.05 teraFLOPS	3,958 teraFLOPs	1,671 TFLOPS
Peak FP16 Tensor Core	125 teraFLOPS | 250 teraFLOPS		242 TFLOPS | Sparsity		362.05 teraFLOPS	3,958 teraFLOPs	1,671 TFLOPS
Peak FP8 Tensor Core			485 TFLOPS | Sparsity		733 teraFLOPS	7,916 teraFLOPs	3,341 TFLOPS
Peak INT4 Tensor Core	500 TOPS | 1,000 TOPS				733 teraFLOPS
Total NVLink Bandwidth					Not supported	600GB/s
Multi-Instance GPUs					No
vGPU Software Support				NVIDIA vPC/vApps, NVIDIA RTX Virtual Workstation (vWS)
NVENC | NVDEC			2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode	3x | 3x (Includes AV1 Encode & Decode)	3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust			Yes	Yes	Yes
NEBS Ready			Yes | Level 3	Yes / Level 3	Level 3
DisplayPort Connectors			None | vGPU Only	4x DP 1.4a	4x DisplayPort 1.4a
Cooling	Passive	Passive	Passive	Passive	Passive	Passive	Passive
Dual Slot	Single-slot	Dual-slot	No	Yes		Yes
Dimensions	FHFL			4.4" (H) x 10.5" (L)	4.4" (H) x 10.5" (L)			4.4” H x 10.5” L, FHFL Dual Slot
Form Factor			6.61” L x 2.71” H (Low-profile)	PCIe		PCIe	Dual-slot air-cooled
Lithography	8 nm							4N NVIDIA Custom Process
Supplementary Power Connectors	None	8-pin CPU		1x 16-pin PCIe CEM5	1x 16-pin			1x PCIe CEM5 16-pin
Max Graphics Card Power (W)	150W	250W	72W	300W	350W	400W	Up to 600W (configurable)	400 W – 600 W (configurable)
Processor								NVIDIA Blackwell Architecture
Memory Bandwidth								Up to 1.6 TB/s
Minimum Recommended Power, Single Card (W)								800
Minimum Recommended Power, 2-Way (W)								1600
Minimum Recommended Power, 3-Way (W)								2000
Minimum Recommended Power, 4-Way (W)								2400
Thermal Solution								Passive
Slot Height								2-Slot
Action	Select	Select	Select	Select	Select	Select	Select	Select