Product | NVIDIA® HGX™ H100 - 8x NVIDIA® H100 SXM5 GPUs - 640GB HBM3 Memory - 4th Generation NVLink | NVIDIA® HGX™ H200 - 8x NVIDIA® H200 SXM5 GPUs - 1128GB HBM3e Memory - 5th Generation NVLink |
Action | Select | Select |
Main Specifications | ||
Product Series | Nvidia H100 | Nvidia H200 |
Core Type | NVIDIA TENSOR | NVIDIA TENSOR |
Host Interface | 8x NVIDIA H100 SXM | 8x NVIDIA H200 SXM |
GPU Architecture | Hopper | Hopper |
Detailed Specifications | ||
Max Memory Size | 80 GB | 141 GB |
Max Memory Bandwidth | 3.35 TB/s | 4.8TB/s |
Peak FP64 | 34 TFLOPS | 34 TFLOPS |
Peak FP64 Tensor Core | 67 TFLOPS | 67 TFLOPS |
INT8 Tensor Core | 3,958 TFLOPS | |
TF32 Tensor Core | 989 TFLOPS | 989 TFLOPS |
FP32 | 67 TFLOPS | 67 TFLOPS |
Peak BFLOAT16 Tensor Core | 1,979 TFLOPS | 1,979 TFLOPS |
Peak FP16 Tensor Core | 1,979 TFLOPS | 1,979 TFLOPS |
Peak FP8 Tensor Core | 3,958 TFLOPS | 3,958 TFLOPS |
Total NVLink Bandwidth | NVLink: 900 GB/s PCIe Gen5: 128 GB/s | NVLink: 900 GB/s PCIe Gen5: 128 GB/s |
Cooling | Passive | Passive |
Max Graphics Card Power (W) | Up to 700W (configurable) | Up to 700W (configurable) |
Action | Select | Select |