ProductNVIDIA® A2 GPU Computing Accelerator - 16GB GDDR6 - PCIe 4.0 x8 - Passive Cooler (w/o CEC)NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive CoolingNVIDIA® L40 ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive CoolingNVIDIA® RTX 6000 Ada Generation - 48GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)NVIDIA® RTX PRO 5000 Blackwell - 48GB GDDR7 ECC - PCIe 5.0 x16 - Active Cooling (4xDP)NVIDIA® RTX PRO 6000 Blackwell Workstation Edition - 96GB GDDR7 ECC - PCIe 5.0 x16 - Active Cooling (4xDP)NVIDIA® RTX PRO 6000 Blackwell Max-Q Workstation Edition - 96GB GDDR7 ECC - PCIe 5.0 x16 - Active Cooling (4xDP)
ActionSelectSelectSelectSelectSelectSelectSelect
Main Specifications
Product Series Nvidia A2Nvidia L4Nvidia L40
Core Type NVIDIA TENSORNVIDIA TENSORNVIDIA TENSOR
Core Clock Speed 1440 MHz (1770 MHz Boost Clock)795 MHz Base | 2040 MHz Boost
Host Interface PCI Express 4.0 x8PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 4.0 x16PCI Express 5.0 x16PCI Express 5.0 x16PCI Express 5.0 x16
GPU Architecture AmpereAda LovelaceAda Lovelace
Product Type WorkstationWorkstationWorkstationWorkstation
Product Line NVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional GraphicsNVIDIA Professional Graphics
Memory Technology GDDR6GDDR7GDDR7GDDR7
Memory Capacity 48 GB with ECC48 GB with ECC96 GB with ECC96 GB with ECC
Max Displays 4 Displays4 Displays4 Displays4 Displays
Detailed Specifications
Streaming Processor Cores 1280 CUDA Cores18,17614,080 CUDA Parallel Processing Cores24,064 CUDA Parallel Processing Cores24,064 CUDA Parallel Processing Cores
NVIDIA Tensor Cores 40 | Gen 3568440752752
NVIDIA RT Cores 10 | Gen 2142110188188
Memory Clock Speed 6251 MHz6251 MHz
Memory Interface 128-bit192-bit384-bit384-bit512-bit512-bit
Max Memory Size 16 GB GDDR6 ECC24 GB48 GB GDDR6 with ECC
Max Memory Bandwidth 200 GB/s300 GB/s
ECC Protection On by DefaultOn by Default
INT8 Tensor Core 485 TOPS | Sparsity
TF32 Tensor Core 9 TFLOPS | 18 TFLOPS Sparsity120 TFLOPS | Sparsity
FP32 4.5 TFLOPS30.3 TFLOPS
Peak BFLOAT16 Tensor Core 242 TFLOPS | Sparsity
Peak FP16 Tensor Core 18 TFLOPS | 36 TFLOPS Sparsity242 TFLOPS | Sparsity
Peak FP8 Tensor Core 485 TFLOPS | Sparsity
Tensor Performance 1457.0 TFLOPS
NVIDIA CUDA™ Technology 11.1 or later
vGPU Software Support NVIDIA vPC/vApps, NVIDIA RTX Virtual Workstation (vWS)
NVENC | NVDEC 2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode3x | 3x (Includes AV1 Encode & Decode)
Secure Boot with Root of Trust YesYes
NEBS Ready Yes | Level 3Yes / Level 3
Peak INT4 Performance 72 TOPS | 144 TOPS Sparsity
Peak INT8 Performance 36 TOPS | 72 TOPS Sparsity
Transistor Count 76.3 billion92.2 Billion92.2 Billion92.2 Billion
DisplayPort Connectors None | vGPU Only4x DP 1.4a
Cooling PassivePassivePassive
Dual Slot Single-slotNoYes
Dimensions 6.61” L x 2.71” H4.4" (H) x 10.5" (L)4.4" H x 10.5" L4.4” H x 10.5” L, FHFL Dual Slot5.4” H x 12” L, XHFL Dual Slot4.4” H x 10.5” L, FHFL Dual Slot
Form Factor Low-Profile PCIe6.61” L x 2.71” H (Low-profile)PCIe
Lithography 4 nm NVIDIA Custom Process4N NVIDIA Custom Process4N NVIDIA Custom Process4N NVIDIA Custom Process
Supplementary Power Connectors 1x 16-pin PCIe CEM51x PCIe CEM5 16-pin1x PCIe CEM5 16-pin1x PCIe CEM5 16-pin1x PCIe CEM5 16-pin
Max Graphics Card Power (W) 40-60 W | Configurable72W300W300W300W600W300W
Processor NVIDIA Ada LovelaceNVIDIA Blackwell ArchitectureNVIDIA Blackwell ArchitectureNVIDIA Blackwell Architecture
Memory Bandwidth 960 GB/s1344 GB/s1792 GB/s1792 GB/s
Peak Single-Precision Performance 125 TFLOPS
AI Performance 4000 AI TOPS2
Peak Single Precision FP32 Performance 91.1 TFLOPS
RT Core Performance 210.6 TFLOPS380 TFLOPS
DisplayPort Output 4x DP 1.4a4x DP 2.14x DP 2.14x DP 2.1
Minimum Recommended Power, Single Card (W) 600600800600
Minimum Recommended Power, 2-Way (W) 7507501600900
Minimum Recommended Power, 3-Way (W) 85085024001200
Minimum Recommended Power, 4-Way (W) 1000100032001600
Thermal Solution Blower Active FanBlower Active FanDouble Flow ThroughBlower Active Fan
Slot Height 2-Slot2-Slot2-Slot2-Slot
ActionSelectSelectSelectSelectSelectSelectSelect