ProductNVIDIA® HGX™ H100 - 8x NVIDIA® H100 SXM5 GPUs - 640GB HBM3 Memory - 4th Generation NVLinkNVIDIA® HGX™ H200 - 8x NVIDIA® H200 SXM5 GPUs - 1128GB HBM3e Memory - 5th Generation NVLink
ActionSelectSelect
Main Specifications
Product Series Nvidia H100Nvidia H200
Core Type NVIDIA TENSORNVIDIA TENSOR
Host Interface 8x NVIDIA H100 SXM8x NVIDIA H200 SXM
GPU Architecture HopperHopper
Detailed Specifications
Max Memory Size 80 GB141 GB
Max Memory Bandwidth 3.35 TB/s4.8TB/s
Peak FP64 34 TFLOPS34 TFLOPS
Peak FP64 Tensor Core 67 TFLOPS67 TFLOPS
INT8 Tensor Core 3,958 TFLOPS
TF32 Tensor Core 989 TFLOPS989 TFLOPS
FP32 67 TFLOPS67 TFLOPS
Peak BFLOAT16 Tensor Core 1,979 TFLOPS1,979 TFLOPS
Peak FP16 Tensor Core 1,979 TFLOPS1,979 TFLOPS
Peak FP8 Tensor Core 3,958 TFLOPS3,958 TFLOPS
Total NVLink Bandwidth NVLink: 900 GB/s
PCIe Gen5: 128 GB/s
NVLink: 900 GB/s
PCIe Gen5: 128 GB/s
Cooling PassivePassive
Max Graphics Card Power (W) Up to 700W (configurable)Up to 700W (configurable)
ActionSelectSelect