| Product | NVIDIA® HGX™ H100 - 4x NVIDIA® H100 SXM5 GPUs - 320GB HBM3 Memory - 4th Generation NVLink | NVIDIA® HGX™ H200 - 4x NVIDIA® H200 SXM5 GPUs - 564GB HBM3e Memory - 4th Generation NVLink |
| Action | Select | Select |
| Main Specifications | ||
| Product Series | Nvidia H100 | Nvidia H200 |
| Core Type | NVIDIA TENSOR | |
| Host Interface | 4x NVIDIA H100 SXM | 4x NVIDIA H200 SXM |
| GPU Architecture | Hopper | Hopper |
| Detailed Specifications | ||
| Max Memory Size | 80 GB | 141 GB |
| Max Memory Bandwidth | 3.35 TB/s | 4.8TB/s |
| Peak FP64 | 34 TFLOPS | 34 TFLOPS |
| Peak FP64 Tensor Core | 67 TFLOPS | 67 TFLOPS |
| INT8 Tensor Core | 3,958 TFLOPS | |
| TF32 Tensor Core | 989 TFLOPS | 989 TFLOPS |
| FP32 | 67 TFLOPS | 67 TFLOPS |
| Peak BFLOAT16 Tensor Core | 1,979 TFLOPS | 1,979 TFLOPS |
| Peak FP16 Tensor Core | 1,979 TFLOPS | 1,979 TFLOPS |
| Peak FP8 Tensor Core | 3,958 TFLOPS | 3,958 TFLOPS |
| Total NVLink Bandwidth | NVLink: 900 GB/s PCIe Gen5: 128 GB/s | NVLink: 900 GB/s PCIe Gen5: 128 GB/s |
| Multi-Instance GPUs | Up to 7 MIGs @18GB each | |
| Cooling | Passive | Passive |
| Form Factor | SXM | |
| Max Graphics Card Power (W) | Up to 700W (configurable) | Up to 700W (configurable) |
| Action | Select | Select |