| Product | NVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling | NVIDIA® H200 NVL GPU - 141GB HBM3e - PCIe 5.0 x16 - Passive Cooling - 600W | AMD Radeon™ AI PRO R9700S - 32GB GDDR6 - PCIe 5.0 x16 - Passive Cooling (4xDP) - 300W | NVIDIA® RTX PRO 6000 Blackwell Server Edition - 96GB GDDR7 - PCIe 5.0 x16 - Passive Cooling (4xDP) - 600W |
| Action | Select | Select | Select | Select |
| Main Specifications | ||||
| Product Series | Nvidia L40S | Nvidia H200 | ||
| Core Type | NVIDIA TENSOR | NVIDIA TENSOR | ||
| Host Interface | PCI Express 4.0 x16 | PCI Express 5.0 x16 | PCI Express 5.0 x16 | PCI Express 5.0 x16 |
| GPU Architecture | Ada Lovelace | Hopper | ||
| Product Type | Workstation | Server | ||
| Product Line | Radeon AI PRO R9000 Series | NVIDIA Professional Graphics | ||
| Memory Technology | GDDR6 with ECC (Linux Only) | GDDR7 | ||
| Memory Capacity | 32 GB | 96 GB with ECC | ||
| Max Displays | 4 Displays | 4 Displays | ||
| Detailed Specifications | ||||
| Streaming Processor Cores | 18,176 | 4096 | 24,064 CUDA Parallel Processing Cores | |
| NVIDIA Tensor Cores | 568 | Gen 4 | 752 (5th Gen) | ||
| NVIDIA RT Cores | 142 | Gen 3 | 188 (4th Gen) | ||
| Memory Interface | 256-bit | 512-bit | ||
| Max Memory Size | 48GB GDDR6 with ECC | 141 GB | ||
| Max Memory Bandwidth | 864 GB/s | 4.8TB/s | ||
| Peak FP64 | 30 TFLOPS | |||
| Peak FP64 Tensor Core | 60 TFLOPS | |||
| INT8 Tensor Core | 733 teraFLOPS | 3,341 TFLOPS | ||
| TF32 Tensor Core | 183 teraFLOPS | 835 TFLOPS | ||
| FP32 | 91.6 teraFLOPS | 60 TFLOPS | ||
| Peak BFLOAT16 Tensor Core | 362.05 teraFLOPS | 1,671 TFLOPS | ||
| Peak FP16 Tensor Core | 362.05 teraFLOPS | 1,671 TFLOPS | ||
| Peak FP8 Tensor Core | 733 teraFLOPS | 3,341 TFLOPS | ||
| Peak INT4 Tensor Core | 733 teraFLOPS | |||
| Total NVLink Bandwidth | Not supported | |||
| Multi-Instance GPUs | No | |||
| NVENC | NVDEC | 3x l 3x (includes AV1 encode and decode) | |||
| Secure Boot with Root of Trust | Yes | |||
| NEBS Ready | Level 3 | |||
| Transistor Count | 53.9 Billion | |||
| DisplayPort Connectors | 4x DisplayPort 1.4a | |||
| Cooling | Passive | Passive | ||
| Dimensions | 4.4" (H) x 10.5" (L) | 4.4” H x 10.5” L, FHFL Dual Slot | ||
| Form Factor | Dual-slot air-cooled | |||
| Lithography | 4N NVIDIA Custom Process | |||
| Supplementary Power Connectors | 1x 16-pin | 12V-2x6 | 1x PCIe CEM5 16-pin | |
| Max Graphics Card Power (W) | 350W | Up to 600W (configurable) | 300W | 400 W – 600 W (configurable) |
| Processor | AMD RDNA™ 4 | NVIDIA Blackwell Architecture | ||
| Memory Bandwidth | 640 GB/s | Up to 1.6 TB/s | ||
| Core Clock Speed | 2350 MHz (Boost Up to 2920 MHz) | |||
| Graphics Resolution | Up to: 4x 4096 x 2160 (4K DCI) @ 120Hz with DSC 2x 6144 x 3456 (6K) 12-bit HDR @ 60Hz Uncompressed 2x 7680 x 4320 (8K) 12-bit HDR @ 60Hz with DSC 1x 12288 x 6912 (12K) @ 120Hz with DSC | |||
| Peak Single Precision FP32 Performance | 47.8 TFLOPs | |||
| Peak Half Precision FP16 Performance | 47.8 TFLOPs | |||
| DisplayPort Output | 4x DP | |||
| Minimum Recommended Power, Single Card (W) | 750W | 800 | ||
| Minimum Recommended Power, 2-Way (W) | 1200 | 1600 | ||
| Minimum Recommended Power, 3-Way (W) | 1600 | 2000 | ||
| Minimum Recommended Power, 4-Way (W) | 2000 | 2400 | ||
| Thermal Solution | Passive Cooled | Passive | ||
| Slot Height | 2-Slot | 2-Slot | ||
| Action | Select | Select | Select | Select |