Product | NVIDIA® HGX™ H100 - 4x NVIDIA® H100 SXM5 GPUs - 320GB HBM3 Memory - 4th Generation NVLink | NVIDIA® HGX™ H200 - 4x NVIDIA® H200 SXM5 GPUs - 564GB HBM3e Memory - 4th Generation NVLink |
Action | Select | Select |
Main Specifications | ||
Product Series | Nvidia H100 | Nvidia H200 |
Core Type | NVIDIA TENSOR | |
Host Interface | 4x NVIDIA H100 SXM | 4x NVIDIA H200 SXM |
GPU Architecture | Hopper | Hopper |
Detailed Specifications | ||
Max Memory Size | 80 GB | 141 GB |
Max Memory Bandwidth | 3.35 TB/s | 4.8TB/s |
Peak FP64 | 34 TFLOPS | 34 TFLOPS |
Peak FP64 Tensor Core | 67 TFLOPS | 67 TFLOPS |
INT8 Tensor Core | 3,958 TFLOPS | |
TF32 Tensor Core | 989 TFLOPS | 989 TFLOPS |
FP32 | 67 TFLOPS | 67 TFLOPS |
Peak BFLOAT16 Tensor Core | 1,979 TFLOPS | 1,979 TFLOPS |
Peak FP16 Tensor Core | 1,979 TFLOPS | 1,979 TFLOPS |
Peak FP8 Tensor Core | 3,958 TFLOPS | 3,958 TFLOPS |
Total NVLink Bandwidth | NVLink: 900 GB/s PCIe Gen5: 128 GB/s | NVLink: 900 GB/s PCIe Gen5: 128 GB/s |
Multi-Instance GPUs | Up to 7 MIGs @18GB each | |
Cooling | Passive | Passive |
Form Factor | SXM | |
Max Graphics Card Power (W) | Up to 700W (configurable) | Up to 700W (configurable) |
Action | Select | Select |