Product Overview

NVIDIA H200 Tensor Core GPU

The NVIDIA H200 Tensor Core GPU transforms generative AI and high-performance computing (HPC) workloads with unprecedented memory capacity and bandwidth. Featuring industry-first HBM3e memory, the H200 accelerates large language models (LLMs), generative AI, and complex scientific simulations, offering superior performance and energy efficiency.

Key Features & Benefits

Llama2 70B Inference: 1.9X Faster
GPT-3 175B Inference: 1.6X Faster
High-Performance Computing: Up to 110X Faster

Core Benefits

Unmatched AI Inference

Supercharged HPC Performance

Energy Efficiency & Sustainability

Enterprise-Ready

NVIDIA H200 NVL: Enterprise-Ready GPU

The NVIDIA H200 Tensor Core GPU delivers groundbreaking performance built on the advanced NVIDIA Hopper™ architecture.

Flexible Configurations for Mainstream Enterprise Servers:

Enterprise Software Included

Specifications

NVIDIA H200 Specifications

Feature	H200 SXM¹	H200 NVL¹
FP64	34 TFLOPS	30 TFLOPS
FP64 Tensor Core	67 TFLOPS	60 TFLOPS
FP32	67 TFLOPS	60 TFLOPS
TF32 Tensor Core²	989 TFLOPS	835 TFLOPS
BFLOAT16 Tensor Core²	1,979 TFLOPS	1,671 TFLOPS
FP16 Tensor Core²	1,979 TFLOPS	1,671 TFLOPS
FP8 Tensor Core²	3,958 TFLOPS	3,341 TFLOPS
INT8 Tensor Core²	3,958 TFLOPS	3,341 TFLOPS
GPU Memory	141 GB HBM3e	141 GB HBM3e
GPU Memory Bandwidth	4.8 TB/s	4.8 TB/s
Confidential Computing	Supported	Supported
Max TDP	Up to 700W	Up to 600W
Multi-Instance GPU	7 MIGs @18GB each	7 MIGs @16.5GB each
Form Factor	SXM	PCIe dual-slot
Interconnect	NVLink: 900GB/s	NVLink bridge: 900GB/s
PCIe Interface	PCIe Gen5: 128GB/s	PCIe Gen5: 128GB/s
Server Options	HGX™ H200 Systems	MGX™ H200 NVL Systems
NVIDIA AI Enterprise	Add-on	Included

Applications

Ideal Applications

The NVIDIA H200 Tensor Core GPU is a powerhouse for demanding AI workloads, deep learning, and high-performance computing (HPC) applications. With its advanced Tensor Cores and high memory bandwidth, it’s ideal for training and deploying large language models (LLMs), generative AI, scientific simulations, and data-intensive analytics.