ProductNVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive CoolingNVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® H100 NVL GPU Computing Accelerator - 94GB HBM3 - PCIe 5.0 x16 - Passive CoolingNVIDIA® RTX A2000 - 12GB GDDR6 - PCIe 4.0 x16 - Active Cooling (4x mDP)NVIDIA® RTX A4000 - 16GB GDDR6 - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX A6000 - 48GB GDDR6 - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX 2000 Ada Generation - 16GB GDDR6 ECC - PCIe 4.0 x8 - Active Cooling (4x mDP)NVIDIA® RTX 4000 SFF Ada Generation - 20GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4x mDP)NVIDIA® RTX 4000 Ada Generation - 20GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX 4500 Ada Generation - 24GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX 5000 Ada Generation - 32GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX 6000 Ada Generation - 48GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)
ActionSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelect
Main Specifications
Product Series Nvidia L4Nvidia L40SNvidia H100 NVL
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Core Clock Speed 795 MHz Base | 2040 MHz Boost
Host Interface PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 5.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x8PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16
GPU Architecture Ada LovelaceAda LovelaceHopper
Product Type WorkstationWorkstationWorkstationWorkstationWorkstationWorkstationWorkstationWorkstation
Product Line NVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional Graphics
Memory Technology GDDR6 with ECCGDDR6 with ECCGDDR6GDDR6 with ECCGDDR6GDDR6GDDR6GDDR6GDDR6
Memory Capacity 12 GB GDDR6 with ECC16 GB GDDR6 with ECC48 GB16 GB20 GB GDDR6 ECC20 GB GDDR6 ECC24 GB GDDR6 ECC32 GB GDDR6 ECC48 GB with ECC
Max Displays 4 Displays4 Displays4 Displays4 Displays
Detailed Specifications
Streaming Processor Cores 18,1763328 CUDA Cores6144 CUDA Cores10752 Shading Units2816 CUDA Cores6144 CUDA Cores6144 CUDA Cores7,680 CUDA Parallel Processing Cores12,800 CUDA Parallel Processing Cores18,176
NVIDIA Tensor Cores 568 | Gen 410419233688192 | Gen 4192240400568
NVIDIA RT Cores 142 | Gen 32648842248 | Gen 34860100142
PCIe x16 Interconnect Bandwidth PCIe Gen5: 128GB/s
Memory Clock Speed 6251 MHz6001 MHz2000 MHz 16 Gbps effective
Memory Interface 192-bit192-bit256-bit384-bit128-bit160-bit160-bit192-bit256-bit384-bit
Max Memory Size 24 GB48GB GDDR6 with ECC94 GB
Max Memory Bandwidth 300 GB/s864 GB/s7.8TB/s
Peak FP64 68 teraFLOPs
Peak FP64 Tensor Core 134 teraFLOPs
Peak FP32 30.3 TFLOPS91.6 teraFLOPS134 teraFLOPs
Peak TF32 Tensor Core 120 TFLOPS | Sparsity183 teraFLOPS1,979 teraFLOPs
Peak BFLOAT16 Tensor Core 242 TFLOPS | Sparsity362.05 teraFLOPS3,958 teraFLOPs
Peak FP16 Tensor Core 242 TFLOPS | Sparsity362.05 teraFLOPS3,958 teraFLOPs
Peak FP8 Tensor Core 485 TFLOPS | Sparsity733 teraFLOPS7,916 teraFLOPs
Peak INT8 Tensor Core 485 TOPS | Sparsity733 teraFLOPS7,916 TOPS
Peak INT4 Tensor Core 733 teraFLOPS
NVIDIA NVLink™ Interconnect Bandwidth Not supported600GB/s
Multi-Instance GPUs No
Tensor Performance 63.9 TFLOPS191.9 TFLOPS306.8 TFLOPS327.6 TFLOPS637.8 TFLOPS1044.4 TFLOPS1457.0 TFLOPS
NVIDIA CUDA™ Technology YesYesYes
NVENC | NVDEC 2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust YesYes
NEBS Ready Yes | Level 3Level 3
ECC Protection On by Default
Transistor Count 13.25 Billion17.4 Billion28.3 Billion19.9 Billion35.8 Billion35.8 Billion35.8 billion76.3 billion76.3 billion
DisplayPort Connectors None | vGPU Only4x DisplayPort 1.4a
Cooling PassivePassivePassive
Dual Slot NoYes
Dimensions 4.4" (H) x 10.5" (L)2.713" H x 6.6" L4.4” H x 9.5” L4.4" (H) x 10.5" (L)2.7” H x 6.6”2.7” H x 6.6”L4.4" (H) x 9.5"(L)4.4" H x 10.5" L4.4" H x 10.5" L4.4" H x 10.5" L
Form Factor 6.61” L x 2.71” H (Low-profile)PCIe
Lithography 8nm8nmSamsung 8nm4N NVIDIA Custom Process4 nm NVIDIA Custom Process4 nm NVIDIA Custom Process
Supplementary Power Connectors 1x 16-pin1x 6-pin PCIe1x 8-pin EPSNo Auxiliary Power Required1x 16-pin CEM5 PCIe1x 16-pin CEM5 PCIe1x PCIe CEM5 16-pin
Max Graphics Card Power (W) 72W350W400W70W140W300W70W70W130W210W250W300W
Processor AmpereAmpere (GA104)Ampere (GA102)NVIDIA Ada Lovelace (AD107)NVIDIA Ada LovelaceNVIDIA Ada LovelaceNVIDIA Ada LovelaceNVIDIA Ada LovelaceNVIDIA Ada Lovelace
Memory Bandwidth 288 GB/sec448 GB/sec768 GB/s224 GB/sec320 GB/s360 GB/s432 GB/s576 GB/s960 GB/s
Core Clock Speed 1455 MHz Base Clock
1860 MHz Boost Clock
L2 Cache Size 6 MB
Peak Single-Precision Performance 12 TFLOPS65.3 TFLOPS
API Support CUDA 8.5, OpenCL 2.0
Shader Model 6.5, OpenGL 4.6, DirectX 12 Ultimate (12_2), Vulkan 1.2
Texture Fill Rate 625 GTexel/s
Graphics Resolution 2x 7680 x 4320 at 60 HzMax Digital Resolution: 7680 x 4320 x36 bpp at 60 Hz7680 x 4320 x36 bpp at 60 Hz7680 x 4320 x36 bpp at 60 Hz
Peak Double Precision FP64 Performance 1,250 GFLOPS (1:32)
Peak Single Precision FP32 Performance 8.0 TFLOPS38.7 TFLOPS19.2 TFLOPS26.7 TFLOPS39.9 TFLOPS91.1 TFLOPS
Peak Half Precision FP16 Performance 40.00 TFLOPS (1:1)
Deep Learning TFLOPS 153.4 TFLOPS
Multi-GPU Scalability NVLINK 2-way low profile (2-slot and 3-slot bridges) connects 2x NVIDIA RTX A6000Not Supported
NVLink Interconnect 112.5 GB/s (bidirectional)Not SupportedNot SupportedNot Supported
RT Core Performance 15.6 TLOPS27.7 TFLOPS44.3 TFLOPS61.8 TFLOPS92.2 TFLOPS151.0 TFLOPS210.6 TFLOPS
VR Ready YesYes
Vulkan API 1.2
DisplayPort Output 4x DisplayPort 1.4a4x DisplayPort 1.4a4x Mini DisplayPort 1.4a4x DP 1.4a
Mini DisplayPort Output 4x mDP Latching4x mDP 1.4a4x mDP 1.4a4x DP 1.4a4x DP 1.4a
Minimum Recommended Power, Single Card (W) 300W700W600
Minimum Recommended Power, 2-Way (W) 500850750
Minimum Recommended Power, 3-Way (W) 8501000850
Minimum Recommended Power, 4-Way (W) 100012001000
Thermal Solution Active HeatsinkActive HeatsinkActive HeatsinkBlower Active FanActive HeatsinkBlower Active FanBlower Active FanBlower Active FanBlower Active Fan
Slot Height 2-SlotSingle Slot2-SlotDual SlotLow Profile Dual SlotSingle Slot2-Slot2-Slot2-Slot
ActionSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelectSelect