| Product | NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive Cooling | NVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling | AMD Radeon™ AI PRO R9700 - 32GB GDDR6 - PCIe 5.0 x16 - Active Cooling (4xDP) - 300W | AMD Radeon™ AI PRO R9700S - 32GB GDDR6 - PCIe 5.0 x16 - Passive Cooling (4xDP) - 300W | NVIDIA® RTX 4500 Ada Generation - 24GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP) | NVIDIA® RTX 6000 Ada Generation - 48GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP) | NVIDIA® RTX PRO 6000 Blackwell Max-Q Workstation Edition - 96GB GDDR7 ECC - PCIe 5.0 x16 - Active Cooling (4xDP) |
| Action | Select | Select | Select | Select | Select | Select | Select |
| Main Specifications | |||||||
| Product Series | Nvidia L4 | Nvidia L40S | |||||
| Core Type | NVIDIA TENSOR | NVIDIA TENSOR | |||||
| Core Clock Speed | 795 MHz Base | 2040 MHz Boost | ||||||
| Host Interface | PCI Express 4.0 x16 | PCI Express 4.0 x16 | PCI Express 5.0 x16 | PCI Express 5.0 x16 | PCI Express 4.0 x16 | PCI Express 4.0 x16 | PCI Express 5.0 x16 |
| GPU Architecture | Ada Lovelace | Ada Lovelace | |||||
| Product Type | Workstation | Workstation | Workstation | Workstation | Workstation | ||
| Product Line | Radeon AI PRO R9000 Series | Radeon AI PRO R9000 Series | NVIDIA Professional Graphics | NVIDIA Professional Graphics | NVIDIA Professional Graphics | ||
| Memory Technology | GDDR6 with ECC (Linux Only) | GDDR6 with ECC (Linux Only) | GDDR6 | GDDR6 | GDDR7 | ||
| Memory Capacity | 32 GB | 32 GB | 24 GB GDDR6 ECC | 48 GB with ECC | 96 GB with ECC | ||
| Max Displays | 4 Displays | 4 Displays | 4 Displays | 4 Displays | |||
| Detailed Specifications | |||||||
| Streaming Processor Cores | 18,176 | 4096 | 4096 | 7,680 CUDA Parallel Processing Cores | 18,176 | 24,064 CUDA Parallel Processing Cores | |
| NVIDIA Tensor Cores | 568 | Gen 4 | 240 | 568 | 752 | |||
| NVIDIA RT Cores | 142 | Gen 3 | 60 | 142 | 188 | |||
| Memory Clock Speed | 6251 MHz | ||||||
| Memory Interface | 192-bit | 256-bit | 256-bit | 192-bit | 384-bit | 512-bit | |
| Max Memory Size | 24 GB | 48GB GDDR6 with ECC | |||||
| Max Memory Bandwidth | 300 GB/s | 864 GB/s | |||||
| ECC Protection | On by Default | ||||||
| INT8 Tensor Core | 485 TOPS | Sparsity | 733 teraFLOPS | |||||
| TF32 Tensor Core | 120 TFLOPS | Sparsity | 183 teraFLOPS | |||||
| FP32 | 30.3 TFLOPS | 91.6 teraFLOPS | |||||
| Peak BFLOAT16 Tensor Core | 242 TFLOPS | Sparsity | 362.05 teraFLOPS | |||||
| Peak FP16 Tensor Core | 242 TFLOPS | Sparsity | 362.05 teraFLOPS | |||||
| Peak FP8 Tensor Core | 485 TFLOPS | Sparsity | 733 teraFLOPS | |||||
| Peak INT4 Tensor Core | 733 teraFLOPS | ||||||
| Total NVLink Bandwidth | Not supported | ||||||
| Multi-Instance GPUs | No | ||||||
| Tensor Performance | 637.8 TFLOPS | 1457.0 TFLOPS | |||||
| NVENC | NVDEC | 2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode | 3x l 3x (includes AV1 encode and decode) | |||||
| Secure Boot with Root of Trust | Yes | Yes | |||||
| NEBS Ready | Yes | Level 3 | Level 3 | |||||
| Transistor Count | 53.9 Billion | 53.9 Billion | 35.8 billion | 76.3 billion | 92.2 Billion | ||
| DisplayPort Connectors | None | vGPU Only | 4x DisplayPort 1.4a | |||||
| Cooling | Passive | Passive | |||||
| Dual Slot | No | ||||||
| Dimensions | 4.4" (H) x 10.5" (L) | 4.4" H x 10.5" L | 4.4" H x 10.5" L | 4.4” H x 10.5” L, FHFL Dual Slot | |||
| Form Factor | 6.61” L x 2.71” H (Low-profile) | ||||||
| Lithography | 4 nm NVIDIA Custom Process | 4N NVIDIA Custom Process | |||||
| Supplementary Power Connectors | 1x 16-pin | 12V-2x6 | 12V-2x6 | 1x 16-pin CEM5 PCIe | 1x PCIe CEM5 16-pin | 1x PCIe CEM5 16-pin | |
| Max Graphics Card Power (W) | 72W | 350W | 300W | 300W | 210W | 300W | 300W |
| Processor | AMD RDNA™ 4 | AMD RDNA™ 4 | NVIDIA Ada Lovelace | NVIDIA Ada Lovelace | NVIDIA Blackwell Architecture | ||
| Memory Bandwidth | 640 GB/s | 640 GB/s | 432 GB/s | 960 GB/s | 1792 GB/s | ||
| Core Clock Speed | 2350 MHz (Boost Up to 2920 MHz) | 2350 MHz (Boost Up to 2920 MHz) | |||||
| Graphics Resolution | Up to: 4x 4096 x 2160 (4K DCI) @ 120Hz with DSC 2x 6144 x 3456 (6K) 12-bit HDR @ 60Hz Uncompressed 2x 7680 x 4320 (8K) 12-bit HDR @ 60Hz with DSC 1x 12288 x 6912 (12K) @ 120Hz with DSC | Up to: 4x 4096 x 2160 (4K DCI) @ 120Hz with DSC 2x 6144 x 3456 (6K) 12-bit HDR @ 60Hz Uncompressed 2x 7680 x 4320 (8K) 12-bit HDR @ 60Hz with DSC 1x 12288 x 6912 (12K) @ 120Hz with DSC | |||||
| Peak Single Precision FP32 Performance | 47.8 TFLOPs | 47.8 TFLOPs | 39.9 TFLOPS | 91.1 TFLOPS | |||
| Peak Half Precision FP16 Performance | 47.8 TFLOPs | 47.8 TFLOPs | |||||
| NVLink Interconnect | Not Supported | ||||||
| RT Core Performance | 92.2 TFLOPS | 210.6 TFLOPS | |||||
| DisplayPort Output | 4x DP | 4x DP | 4x DP 1.4a | 4x DP 2.1 | |||
| Mini DisplayPort Output | 4x DP 1.4a | ||||||
| Minimum Recommended Power, Single Card (W) | 750W | 750W | 600 | 600 | |||
| Minimum Recommended Power, 2-Way (W) | 1200 | 1200 | 750 | 900 | |||
| Minimum Recommended Power, 3-Way (W) | 1600 | 1600 | 850 | 1200 | |||
| Minimum Recommended Power, 4-Way (W) | 2000 | 2000 | 1000 | 1600 | |||
| Thermal Solution | Active Cooled | Passive Cooled | Blower Active Fan | Blower Active Fan | Blower Active Fan | ||
| Slot Height | 2-Slot | 2-Slot | 2-Slot | 2-Slot | 2-Slot | ||
| Action | Select | Select | Select | Select | Select | Select | Select |