| Product | NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive Cooling | NVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling | AMD Radeon™ AI PRO R9700S - 32GB GDDR6 - PCIe 5.0 x16 - Passive Cooling (4xDP) - 300W | NVIDIA® RTX 6000 Ada Generation - 48GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP) | NVIDIA® RTX PRO 4000 Blackwell - 24GB GDDR7 ECC - PCIe 5.0 x16 - Active Cooling (4xDP) | NVIDIA® RTX PRO 4000 Blackwell - 24GB GDDR7 ECC - PCIe 5.0 x16 - Active Cooling (4x mDP) - SFF | NVIDIA® RTX PRO 4500 Blackwell - 32GB GDDR7 ECC - PCIe 5.0 x16 - Active Cooling (4xDP) | NVIDIA® RTX PRO 4500 Blackwell Server Edition - 32GB GDDR7 ECC - PCIe 5.0 x16 - Passive Cooling | NVIDIA® RTX PRO 5000 Blackwell - 48GB GDDR7 ECC - PCIe 5.0 x16 - Active Cooling (4xDP) | NVIDIA® RTX PRO 6000 Blackwell Max-Q Workstation Edition - 96GB GDDR7 ECC - PCIe 5.0 x16 - Active Cooling (4xDP) |
| Action | Select | Select | Select | Select | Select | Select | Select | Select | Select | Select |
| Main Specifications | ||||||||||
| Product Series | Nvidia L4 | Nvidia L40S | ||||||||
| Core Type | NVIDIA TENSOR | NVIDIA TENSOR | ||||||||
| Core Clock Speed | 795 MHz Base | 2040 MHz Boost | |||||||||
| Host Interface | PCI Express 4.0 x16 | PCI Express 4.0 x16 | PCI Express 5.0 x16 | PCI Express 4.0 x16 | PCI Express 5.0 x16 | PCI Express 5.0 x16 | PCI Express 5.0 x16 | PCI Express 5.0 x16 | PCI Express 5.0 x16 | PCI Express 5.0 x16 |
| GPU Architecture | Ada Lovelace | Ada Lovelace | ||||||||
| Product Type | Workstation | Workstation | Workstation | Workstation | Workstation | Server | Workstation | Workstation | ||
| Product Line | Radeon AI PRO R9000 Series | NVIDIA Professional Graphics | NVIDIA Professional Graphics | NVIDIA Professional Graphics | NVIDIA Professional Graphics | NVIDIA Professional Graphics | NVIDIA Professional Graphics | NVIDIA Professional Graphics | ||
| Memory Technology | GDDR6 with ECC (Linux Only) | GDDR6 | GDDR7 | GDDR7 | GDDR7 | GDDR7 | GDDR7 | GDDR7 | ||
| Memory Capacity | 32 GB | 48 GB with ECC | 24 GB with ECC | 24 GB with ECC | 32 GB with ECC | 32 GB | 48 GB with ECC | 96 GB with ECC | ||
| Max Displays | 4 Displays | 4 Displays | 4 Displays | 4 Displays | 4 Displays | 4 Displays | 4 Displays | |||
| Detailed Specifications | ||||||||||
| Streaming Processor Cores | 18,176 | 4096 | 18,176 | 8960 CUDA Parallel Processing Cores | 10,496 CUDA Parallel Processing Cores | 10,496 CUDA Parallel Processing Cores | 14,080 CUDA Parallel Processing Cores | 24,064 CUDA Parallel Processing Cores | ||
| NVIDIA Tensor Cores | 568 | Gen 4 | 568 | 280 | 328 | 203 (5th Gen) | 440 | 752 | |||
| NVIDIA RT Cores | 142 | Gen 3 | 142 | 70 | 82 | 82 (4th Gen) | 110 | 188 | |||
| Memory Clock Speed | 6251 MHz | |||||||||
| Memory Interface | 192-bit | 256-bit | 384-bit | 192-bit | 256-bit | 256-bit | 384-bit | 512-bit | ||
| Max Memory Size | 24 GB | 48GB GDDR6 with ECC | ||||||||
| Max Memory Bandwidth | 300 GB/s | 864 GB/s | ||||||||
| ECC Protection | On by Default | |||||||||
| INT8 Tensor Core | 485 TOPS | Sparsity | 733 teraFLOPS | ||||||||
| TF32 Tensor Core | 120 TFLOPS | Sparsity | 183 teraFLOPS | ||||||||
| Peak BFLOAT16 Tensor Core | 242 TFLOPS | Sparsity | 362.05 teraFLOPS | ||||||||
| Peak FP16 Tensor Core | 242 TFLOPS | Sparsity | 362.05 teraFLOPS | ||||||||
| Peak FP8 Tensor Core | 485 TFLOPS | Sparsity | 733 teraFLOPS | ||||||||
| Peak INT4 Tensor Core | 733 teraFLOPS | |||||||||
| Total NVLink Bandwidth | Not supported | |||||||||
| Multi-Instance GPUs | No | |||||||||
| Tensor Performance | 1457.0 TFLOPS | |||||||||
| NVENC | NVDEC | 2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode | 3x l 3x (includes AV1 encode and decode) | ||||||||
| Secure Boot with Root of Trust | Yes | Yes | ||||||||
| NEBS Ready | Yes | Level 3 | Level 3 | ||||||||
| Transistor Count | 53.9 Billion | 76.3 billion | 45.6 Billion | 45.6 Billion | 92.2 Billion | 92.2 Billion | ||||
| DisplayPort Connectors | None | vGPU Only | 4x DisplayPort 1.4a | ||||||||
| Cooling | Passive | Passive | ||||||||
| Dual Slot | No | |||||||||
| Dimensions | 4.4" (H) x 10.5" (L) | 4.4" H x 10.5" L | 4.4" H x 9.5" L, single height | 2.7” H x 6.6” L, HHHL Dual Slot | 4.4" H x 10.5" L | 4.4" H x 10.5" L | 4.4” H x 10.5” L, FHFL Dual Slot | 4.4” H x 10.5” L, FHFL Dual Slot | ||
| Form Factor | 6.61” L x 2.71” H (Low-profile) | |||||||||
| Lithography | 4 nm NVIDIA Custom Process | 4N NVIDIA Custom Process | 4 nm Custom Process | 4N NVIDIA Custom Process | 4N NVIDIA Custom Process | |||||
| Supplementary Power Connectors | 1x 16-pin | 12V-2x6 | 1x PCIe CEM5 16-pin | 1x PCIe CEM5 16-pin | 1x PCIe CEM5 16-pin | 1x PCIe CEM5 16-pin | 1x PCIe CEM5 16-pin | 1x PCIe CEM5 16-pin | 1x PCIe CEM5 16-pin | |
| Max Graphics Card Power (W) | 72W | 350W | 300W | 300W | 140W | 70W | 200W | 165W | 300W | 300W |
| Processor | AMD RDNA™ 4 | NVIDIA Ada Lovelace | NVIDIA Blackwell Architecture | NVIDIA Blackwell Architecture | NVIDIA Blackwell Architecture | NVIDIA Blackwell Architecture | NVIDIA Blackwell Architecture | NVIDIA Blackwell Architecture | ||
| Memory Bandwidth | 640 GB/s | 960 GB/s | 672 GB/s | 896 GB/s | 800 GB/s | 1344 GB/s | 1792 GB/s | |||
| Core Clock Speed | 2350 MHz (Boost Up to 2920 MHz) | |||||||||
| Graphics Resolution | Up to: 4x 4096 x 2160 (4K DCI) @ 120Hz with DSC 2x 6144 x 3456 (6K) 12-bit HDR @ 60Hz Uncompressed 2x 7680 x 4320 (8K) 12-bit HDR @ 60Hz with DSC 1x 12288 x 6912 (12K) @ 120Hz with DSC | |||||||||
| Peak Single Precision FP32 Performance | 47.8 TFLOPs | 91.1 TFLOPS | 51 TFLOPS | |||||||
| Peak Half Precision FP16 Performance | 47.8 TFLOPs | |||||||||
| RT Core Performance | 210.6 TFLOPS | |||||||||
| DisplayPort Output | 4x DP | 4x DP 1.4a | 4x DP 2.1 | 4x DP 2.1 | 4x DP 2.1 | 4x DP 2.1 | ||||
| Mini DisplayPort Output | 4x mDP 2.1 | |||||||||
| Minimum Recommended Power, Single Card (W) | 750W | 600 | 550 | 550 | 600 | 750 | ||||
| Minimum Recommended Power, 2-Way (W) | 1200 | 750 | ||||||||
| Minimum Recommended Power, 3-Way (W) | 1600 | 850 | ||||||||
| Minimum Recommended Power, 4-Way (W) | 2000 | 1000 | ||||||||
| Thermal Solution | Passive Cooled | Blower Active Fan | Blower Active Fan | Blower Active Fan | Blower Active Fan | Passive | Blower Active Fan | Blower Active Fan | ||
| Slot Height | 2-Slot | 2-Slot | 1-Slot | 2-Slot | 2-Slot | Single Slot | 2-Slot | 2-Slot | ||
| Action | Select | Select | Select | Select | Select | Select | Select | Select | Select | Select |