Product	NVIDIA® A10 GPU Computing Accelerator - 24GB GDDR6 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)	NVIDIA® A16 GPU Computing Accelerator - 64GB (4x 16GB) GDDR6 - PCIe 4.0 x16 - Passive Cooler (w/o CEC)	NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive Cooling	NVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling
Action	Select	Select	Select	Select
Main Specifications
Product Series	Nvidia A10	Nvidia A16	Nvidia L4	Nvidia L40S
Core Type	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR
Core Clock Speed	885 MHz (1695 MHz Boost Clock)		795 MHz Base | 2040 MHz Boost
Host Interface	PCI Express 4.0 x16 64GB/s	PCI Express 4.0 x16	PCI Express 4.0 x16	PCI Express 4.0 x16
GPU Architecture	Ampere	Ampere	Ada Lovelace	Ada Lovelace
Detailed Specifications
Streaming Processor Cores				18,176
NVIDIA Tensor Cores				568 | Gen 4
NVIDIA RT Cores	72 RT Cores			142 | Gen 3
Memory Clock Speed	1563 MHz		6251 MHz
Memory Interface			192-bit
Max Memory Size	24 GB GDDR6	4x 16GB GDDR6 with error-correcting code (ECC)	24 GB	48GB GDDR6 with ECC
Max Memory Bandwidth	600 GB/s	4x 232GB/s	300 GB/s	864 GB/s
ECC Protection			On by Default
INT8 Tensor Core	250 TOPS | 500 TOPS		485 TOPS | Sparsity	733 teraFLOPS
TF32 Tensor Core	62.5 teraFLOPS | 125 teraFLOPS		120 TFLOPS | Sparsity	183 teraFLOPS
FP32	31.2 teraFLOPS		30.3 TFLOPS	91.6 teraFLOPS
Peak BFLOAT16 Tensor Core	125 teraFLOPS | 250 teraFLOPS		242 TFLOPS | Sparsity	362.05 teraFLOPS
Peak FP16 Tensor Core	125 teraFLOPS | 250 teraFLOPS		242 TFLOPS | Sparsity	362.05 teraFLOPS
Peak FP8 Tensor Core			485 TFLOPS | Sparsity	733 teraFLOPS
Peak INT4 Tensor Core	500 TOPS | 1,000 TOPS			733 teraFLOPS
Total NVLink Bandwidth				Not supported
Multi-Instance GPUs				No
NVENC | NVDEC			2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode	3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust			Yes	Yes
NEBS Ready			Yes | Level 3	Level 3
DisplayPort Connectors			None | vGPU Only	4x DisplayPort 1.4a
Cooling	Passive	Passive	Passive	Passive
Dual Slot	Single-slot	Dual-slot	No
Dimensions	FHFL			4.4" (H) x 10.5" (L)
Form Factor			6.61” L x 2.71” H (Low-profile)
Lithography	8 nm
Supplementary Power Connectors	None	8-pin CPU		1x 16-pin
Max Graphics Card Power (W)	150W	250W	72W	350W
Action	Select	Select	Select	Select