| | | | | | | | | |
Product | NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive Cooling | NVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling | NVIDIA® H100 NVL GPU Computing Accelerator - 94GB HBM3 - PCIe 5.0 x16 - Passive Cooling | NVIDIA® RTX 2000 Ada Generation - 16GB GDDR6 ECC - PCIe 4.0 x8 - Active Cooling (4x mDP) | NVIDIA® RTX 4000 SFF Ada Generation - 20GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4x mDP) | NVIDIA® RTX 4000 Ada Generation - 20GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP) | NVIDIA® RTX 4500 Ada Generation - 24GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP) | NVIDIA® RTX 5000 Ada Generation - 32GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP) | NVIDIA® RTX 6000 Ada Generation - 48GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP) |
Action | Select | Select | Select | Select | Select | Select | Select | Select | Select |
Main Specifications |
Product Series |
Nvidia L4 | Nvidia L40S | Nvidia H100 NVL | | | | | | |
Core Type |
NVIDIA TENSOR | NVIDIA TENSOR | NVIDIA TENSOR | | | | | | |
Core Clock Speed |
795 MHz Base | 2040 MHz Boost | | | | | | | | |
Host Interface |
PCI Express 4.0 x16 | PCI Express 4.0 x16 | PCI Express 5.0 x16 | PCI Express 4.0 x8 | PCI Express 4.0 x16 | PCI Express 4.0 x16 | PCI Express 4.0 x16 | PCI Express 4.0 x16 | PCI Express 4.0 x16 |
GPU Architecture |
Ada Lovelace | Ada Lovelace | Hopper | | | | | | |
Product Type |
| | | Workstation | Workstation | | Workstation | Workstation | Workstation |
Product Line |
| | | NVIDIA Professional Graphics | NVIDIA Professional Graphics | NVIDIA Professional Graphics | NVIDIA Professional Graphics | NVIDIA Professional Graphics | NVIDIA Professional Graphics |
Memory Technology |
| | | GDDR6 with ECC | GDDR6 | GDDR6 | GDDR6 | GDDR6 | GDDR6 |
Memory Capacity |
| | | 16 GB | 20 GB GDDR6 ECC | 20 GB GDDR6 ECC | 24 GB GDDR6 ECC | 32 GB GDDR6 ECC | 48 GB with ECC |
Max Displays |
| | | | | | | 4 Displays | 4 Displays |
Detailed Specifications |
Streaming Processor Cores |
| 18,176 | | 2816 CUDA Cores | 6144 CUDA Cores | 6144 CUDA Cores | 7,680 CUDA Parallel Processing Cores | 12,800 CUDA Parallel Processing Cores | 18,176 |
NVIDIA Tensor Cores |
| 568 | Gen 4 | | 88 | 192 | Gen 4 | 192 | 240 | 400 | 568 |
NVIDIA RT Cores |
| 142 | Gen 3 | | 22 | 48 | Gen 3 | 48 | 60 | 100 | 142 |
PCIe x16 Interconnect Bandwidth |
| | PCIe Gen5: 128GB/s | | | | | | |
Memory Clock Speed |
6251 MHz | | | | | | | | |
Memory Interface |
192-bit | | | 128-bit | 160-bit | 160-bit | 192-bit | 256-bit | 384-bit |
Max Memory Size |
24 GB | 48GB GDDR6 with ECC | 94 GB | | | | | | |
Max Memory Bandwidth |
300 GB/s | 864 GB/s | 7.8TB/s | | | | | | |
Peak FP64 |
| | 68 teraFLOPs | | | | | | |
Peak FP64 Tensor Core |
| | 134 teraFLOPs | | | | | | |
INT8 Tensor Core |
485 TOPS | Sparsity | 733 teraFLOPS | 7,916 TOPS | | | | | | |
TF32 Tensor Core |
120 TFLOPS | Sparsity | 183 teraFLOPS | 1,979 teraFLOPs | | | | | | |
FP32 |
30.3 TFLOPS | 91.6 teraFLOPS | 134 teraFLOPs | | | | | | |
Peak BFLOAT16 Tensor Core |
242 TFLOPS | Sparsity | 362.05 teraFLOPS | 3,958 teraFLOPs | | | | | | |
Peak FP16 Tensor Core |
242 TFLOPS | Sparsity | 362.05 teraFLOPS | 3,958 teraFLOPs | | | | | | |
Peak FP8 Tensor Core |
485 TFLOPS | Sparsity | 733 teraFLOPS | 7,916 teraFLOPs | | | | | | |
Peak INT4 Tensor Core |
| 733 teraFLOPS | | | | | | | |
Total NVLink Bandwidth |
| Not supported | 600GB/s | | | | | | |
Multi-Instance GPUs |
| No | | | | | | | |
Tensor Performance |
| | | 191.9 TFLOPS | 306.8 TFLOPS | 327.6 TFLOPS | 637.8 TFLOPS | 1044.4 TFLOPS | 1457.0 TFLOPS |
NVIDIA CUDA™ Technology |
| | | | Yes | | | | |
NVENC | NVDEC |
2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode | 3x l 3x (includes AV1 encode and decode) | | | | | | | |
Secure Boot with Root of Trust |
Yes | Yes | | | | | | | |
NEBS Ready |
Yes | Level 3 | Level 3 | | | | | | | |
ECC Protection |
On by Default | | | | | | | | |
Transistor Count |
| | | 19.9 Billion | 35.8 Billion | 35.8 Billion | 35.8 billion | 76.3 billion | 76.3 billion |
DisplayPort Connectors |
None | vGPU Only | 4x DisplayPort 1.4a | | | | | | | |
Cooling |
Passive | Passive | Passive | | | | | | |
Dual Slot |
No | | Yes | | | | | | |
Dimensions |
| 4.4" (H) x 10.5" (L) | | 2.7” H x 6.6” | 2.7” H x 6.6”L | 4.4" (H) x 9.5"(L) | 4.4" H x 10.5" L | 4.4" H x 10.5" L | 4.4" H x 10.5" L |
Form Factor |
6.61” L x 2.71” H (Low-profile) | | PCIe | | | | | | |
Lithography |
| | | 4N NVIDIA Custom Process | | | | 4 nm NVIDIA Custom Process | 4 nm NVIDIA Custom Process |
Supplementary Power Connectors |
| 1x 16-pin | | | No Auxiliary Power Required | | 1x 16-pin CEM5 PCIe | 1x 16-pin CEM5 PCIe | 1x PCIe CEM5 16-pin |
Max Graphics Card Power (W) |
72W | 350W | 400W | 70W | 70W | 130W | 210W | 250W | 300W |
Processor |
| | | NVIDIA Ada Lovelace (AD107) | NVIDIA Ada Lovelace | NVIDIA Ada Lovelace | NVIDIA Ada Lovelace | NVIDIA Ada Lovelace | NVIDIA Ada Lovelace |
Memory Bandwidth |
| | | 224 GB/sec | 320 GB/s | 360 GB/s | 432 GB/s | 576 GB/s | 960 GB/s |
Peak Single-Precision Performance |
| | | 12 TFLOPS | | | | 65.3 TFLOPS | |
Graphics Resolution |
| | | 7680 x 4320 x36 bpp at 60 Hz | | | | | |
Peak Single Precision FP32 Performance |
| | | | 19.2 TFLOPS | 26.7 TFLOPS | 39.9 TFLOPS | | 91.1 TFLOPS |
Multi-GPU Scalability |
| | | Not Supported | | | | | |
NVLink Interconnect |
| | | | | Not Supported | Not Supported | Not Supported | |
RT Core Performance |
| | | 27.7 TFLOPS | 44.3 TFLOPS | 61.8 TFLOPS | 92.2 TFLOPS | 151.0 TFLOPS | 210.6 TFLOPS |
VR Ready |
| | | | Yes | | | | |
DisplayPort Output |
| | | 4x Mini DisplayPort 1.4a | | | | | 4x DP 1.4a |
Mini DisplayPort Output |
| | | | 4x mDP 1.4a | 4x mDP 1.4a | 4x DP 1.4a | 4x DP 1.4a | |
Minimum Recommended Power, Single Card (W) |
| | | | | | | | 600 |
Minimum Recommended Power, 2-Way (W) |
| | | | | | | | 750 |
Minimum Recommended Power, 3-Way (W) |
| | | | | | | | 850 |
Minimum Recommended Power, 4-Way (W) |
| | | | | | | | 1000 |
Thermal Solution |
| | | Blower Active Fan | Active Heatsink | Blower Active Fan | Blower Active Fan | Blower Active Fan | Blower Active Fan |
Slot Height |
| | | Dual Slot | Low Profile Dual Slot | Single Slot | 2-Slot | 2-Slot | 2-Slot |
Action | Select | Select | Select | Select | Select | Select | Select | Select | Select |