Product	AMD Instinct™ MI350P - 144GB HBM3e - PCIe 5.0 x16 - Passive Cooling - 600W TDP	NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive Cooling	NVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling	NVIDIA® H200 NVL GPU - 141GB HBM3e - PCIe 5.0 x16 - Passive Cooling - 600W	NVIDIA® RTX 6000 Ada Generation - 48GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP)	NVIDIA® RTX PRO 6000 Blackwell Server Edition - 96GB GDDR7 - PCIe 5.0 x16 - Passive Cooling (4xDP) - 600W
Action	Select	Select	Select	Select	Select	Select
Main Specifications
Product Series	AMD Instinct MI350 Series	Nvidia L4	Nvidia L40S	Nvidia H200
Core Type		NVIDIA TENSOR	NVIDIA TENSOR	NVIDIA TENSOR
Core Clock Speed	2200 MHz	795 MHz Base | 2040 MHz Boost
Host Interface	PCI Express 5.0 x16	PCI Express 4.0 x16	PCI Express 4.0 x16	PCI Express 5.0 x16	PCI Express 4.0 x16	PCI Express 5.0 x16
GPU Architecture	CDNA4	Ada Lovelace	Ada Lovelace	Hopper
Product Type					Workstation	Server
Product Line					NVIDIA Professional Graphics	NVIDIA Professional Graphics
Memory Technology					GDDR6	GDDR7
Memory Capacity					48 GB with ECC	96 GB with ECC
Max Displays					4 Displays	4 Displays
Detailed Specifications
Streaming Processor Cores	8,192		18,176		18,176	24,064 CUDA Parallel Processing Cores
Matrix Cores	512
Compute Units	128
NVIDIA Tensor Cores			568 | Gen 4		568	752 (5th Gen)
NVIDIA RT Cores			142 | Gen 3		142	188 (4th Gen)
Memory Clock Speed		6251 MHz
Memory Interface		192-bit			384-bit	512-bit
Max Memory Size	144 GB HBM3E	24 GB	48GB GDDR6 with ECC	141 GB
Max Memory Bandwidth	4 TB/s	300 GB/s	864 GB/s	4.8TB/s
ECC Protection		On by Default
Peak FP64				30 TFLOPS
Peak FP64 Tensor Core				60 TFLOPS
INT8 Tensor Core		485 TOPS | Sparsity	733 teraFLOPS	3,341 TFLOPS
TF32 Tensor Core		120 TFLOPS | Sparsity	183 teraFLOPS	835 TFLOPS
Peak BFLOAT16 Tensor Core		242 TFLOPS | Sparsity	362.05 teraFLOPS	1,671 TFLOPS
Peak FP16 Tensor Core		242 TFLOPS | Sparsity	362.05 teraFLOPS	1,671 TFLOPS
Peak FP8 Tensor Core		485 TFLOPS | Sparsity	733 teraFLOPS	3,341 TFLOPS
Peak INT4 Tensor Core			733 teraFLOPS
Total NVLink Bandwidth			Not supported
Multi-Instance GPUs			No
Tensor Performance					1457.0 TFLOPS
NVENC | NVDEC		2 | 4 | 4 | JPEG Decoders | AV1 Encode and Decode	3x l 3x (includes AV1 encode and decode)
Secure Boot with Root of Trust		Yes	Yes
NEBS Ready		Yes | Level 3	Level 3
Peak Microscaling Four-bit Precision Matrix (MXFP4) Performance	4.6 PFLOPs
Peak Microscaling Six-bit Precision Matrix (MXFP6) Performance	4.6 PFLOPs
Peak Half Precision (FP16) Performance	72 TFLOPs
Peak Half Precision Matrix (FP16) Performance	1.15 PFLOPs
Peak Double Precision Matrix (FP64) Performance	36 TFLOPs
Peak Double Precision (FP64) Performance	36 TFLOPs
Peak INT8 Performance	2.3 POPs
Peak bfloat16	1.15 PFLOPs
Transistor Count	73 Billion				76.3 billion
DisplayPort Connectors		None | vGPU Only	4x DisplayPort 1.4a
Cooling	Passive	Passive	Passive	Passive
Dual Slot	Double Slot	No
Dimensions	10.5" (267 mm) Board Length		4.4" (H) x 10.5" (L)		4.4" H x 10.5" L	4.4” H x 10.5” L, FHFL Dual Slot
Form Factor	PCIe® Add-in Card	6.61” L x 2.71” H (Low-profile)		Dual-slot air-cooled
Lithography	TSMC 3nm | 6nm FinFET				4 nm NVIDIA Custom Process	4N NVIDIA Custom Process
Supplementary Power Connectors			1x 16-pin		1x PCIe CEM5 16-pin	1x PCIe CEM5 16-pin
Max Graphics Card Power (W)	600W TBP (Max); 450W TBP configurable	72W	350W	Up to 600W (configurable)	300W	400 W – 600 W (configurable)
Processor					NVIDIA Ada Lovelace	NVIDIA Blackwell Architecture
Memory Bandwidth					960 GB/s	Up to 1.6 TB/s
Peak Single Precision FP32 Performance					91.1 TFLOPS
RT Core Performance					210.6 TFLOPS
DisplayPort Output					4x DP 1.4a
Minimum Recommended Power, Single Card (W)					600	1000
Minimum Recommended Power, 2-Way (W)						1600
Minimum Recommended Power, 3-Way (W)						2000
Minimum Recommended Power, 4-Way (W)						2400
Thermal Solution					Blower Active Fan	Passive
Slot Height					2-Slot	2-Slot
Action	Select	Select	Select	Select	Select	Select