ProductNVIDIA® HGX™ H100 - 4x NVIDIA® H100 SXM5 GPUs - 320GB HBM3 Memory - 4th Generation NVLinkNVIDIA® HGX™ H200 - 4x NVIDIA® H200 SXM5 GPUs - 564GB HBM3e Memory - 4th Generation NVLink
ActionSelectSelect
Main Specifications
Product Series Nvidia H100Nvidia H200
Core Type NVIDIA TENSOR
Host Interface 4x NVIDIA H100 SXM4x NVIDIA H200 SXM
GPU Architecture HopperHopper
Detailed Specifications
Max Memory Size 80 GB141 GB
Max Memory Bandwidth 3.35 TB/s4.8TB/s
Peak FP64 34 TFLOPS34 TFLOPS
Peak FP64 Tensor Core 67 TFLOPS67 TFLOPS
INT8 Tensor Core 3,958 TFLOPS
TF32 Tensor Core 989 TFLOPS989 TFLOPS
FP32 67 TFLOPS67 TFLOPS
Peak BFLOAT16 Tensor Core 1,979 TFLOPS1,979 TFLOPS
Peak FP16 Tensor Core 1,979 TFLOPS1,979 TFLOPS
Peak FP8 Tensor Core 3,958 TFLOPS3,958 TFLOPS
Total NVLink Bandwidth NVLink: 900 GB/s
PCIe Gen5: 128 GB/s
NVLink: 900 GB/s
PCIe Gen5: 128 GB/s
Multi-Instance GPUs Up to 7 MIGs @18GB each
Cooling PassivePassive
Form Factor SXM
Max Graphics Card Power (W) Up to 700W (configurable)Up to 700W (configurable)
ActionSelectSelect