Key Information
Brand
NVIDIA
Model
H100
Type
GPU
Category
gpu
General
Architecture
Hopper
Cuda cores
16896
Base clock GHz
1
Boost clock GHz
1.59
Studio drivers
true
Apis supported
CUDA
OpenCL
OpenCL
Pci express
Gen 5
Nvidia omniverse
true
Key benefits
Top-tier AI training and inference
Supports largest LLM models
Massive FP16 / FP32 compute
Data center optimized
Supports largest LLM models
Massive FP16 / FP32 compute
Data center optimized
Vram
Capacity GB
80
Type
HBM3
Bus width bits
8192
Tensor cores
Generation
4
Ai tops
1000
Ray tracing
Nvenc
Generation
8
Count
1
Nvdec
Generation
8
Power
Total graphics power W
700
Recommended system power W
1200
Thermal
Max temperature C
85
Physical
Length mm
312
Width mm
111
Slot size
4-slot
Power
Power Rating
Total graphics power W: 700 • Recommended system power W: 1200
You must be logged in to post a comment.