
900-21010-0020-000 NVIDIA H100 NVL 94GB PCIe Accelerator - NEW - 3 YEAR WARRANTY
The NVIDIA® H100 NVL Tensor Core GPU is the most optimized platform for LLMÂ
Inferences with its high compute density, high memory bandwidth, high energyÂ
efficiency, and unique NVLink architecture. It also delivers unprecedented accelerationÂ
to power the world’s highest-performing elastic data centers for AI, data analytics, andÂ
high-performance computing (HPC) applications. NVIDIA H100 NVL Tensor CoreÂ
technology supports a broad range of math precisions, providing a single accelerator forÂ
every compute workload. The NVIDIA H100 NVL supports double precision (FP64), singleprecision (FP32), half precision (FP16), 8-bit floating point (FP8), and integer (INT8)Â
compute tasks.
The NVIDIA H100 NVL card is a dual-slot 10.5 inch PCI Express Gen5 card based on theÂ
NVIDIA Hopper™ architecture. It uses a passive heat sink for cooling, which requiresÂ
system airflow to operate the card properly within its thermal limits. The NVIDIA H100Â
NVL operates unconstrained up to its maximum thermal design power (TDP) level of 400Â
W to accelerate applications that require the fastest computational speed and highestÂ
data throughput. The NVIDIA H100 NVL debuts the world’s highest PCIe card memoryÂ
bandwidth of nearly 4,000 gigabytes per second (GBps). This speeds time to solution forÂ
the largest models and most massive data sets.
The NVIDIA H100 NVL card features Multi-Instance GPU (MIG) capability. This can beÂ
used to partition the GPU into as many as seven hardware isolated GPU instances,Â
providing a unified platform that enables elastic data centers to adjust dynamically toÂ
shifting workload demands. As well as it can allocate the right size of resources from theÂ
smallest to biggest multi-GPU jobs. NVIDIA H100 NVL versatility means that IT managersÂ
can maximize the utility of every graphics processing unit (GPU) in their data center.
NVIDIA H100 NVL cards use three NVIDIA® NVLink® bridges. They are the same as theÂ
one used with NVIDIA H100 PCIe cards. This allows two NVIDIA H100 PCIe cards to beÂ
connected to deliver 600 GB/s bidirectional bandwidth or 10x the bandwidth of PCIeÂ
Gen4, to maximize application performance for large workloads
Product Information
Product Information
Shipping & Returns
Shipping & Returns
Description
The NVIDIA® H100 NVL Tensor Core GPU is the most optimized platform for LLMÂ
Inferences with its high compute density, high memory bandwidth, high energyÂ
efficiency, and unique NVLink architecture. It also delivers unprecedented accelerationÂ
to power the world’s highest-performing elastic data centers for AI, data analytics, andÂ
high-performance computing (HPC) applications. NVIDIA H100 NVL Tensor CoreÂ
technology supports a broad range of math precisions, providing a single accelerator forÂ
every compute workload. The NVIDIA H100 NVL supports double precision (FP64), singleprecision (FP32), half precision (FP16), 8-bit floating point (FP8), and integer (INT8)Â
compute tasks.
The NVIDIA H100 NVL card is a dual-slot 10.5 inch PCI Express Gen5 card based on theÂ
NVIDIA Hopper™ architecture. It uses a passive heat sink for cooling, which requiresÂ
system airflow to operate the card properly within its thermal limits. The NVIDIA H100Â
NVL operates unconstrained up to its maximum thermal design power (TDP) level of 400Â
W to accelerate applications that require the fastest computational speed and highestÂ
data throughput. The NVIDIA H100 NVL debuts the world’s highest PCIe card memoryÂ
bandwidth of nearly 4,000 gigabytes per second (GBps). This speeds time to solution forÂ
the largest models and most massive data sets.
The NVIDIA H100 NVL card features Multi-Instance GPU (MIG) capability. This can beÂ
used to partition the GPU into as many as seven hardware isolated GPU instances,Â
providing a unified platform that enables elastic data centers to adjust dynamically toÂ
shifting workload demands. As well as it can allocate the right size of resources from theÂ
smallest to biggest multi-GPU jobs. NVIDIA H100 NVL versatility means that IT managersÂ
can maximize the utility of every graphics processing unit (GPU) in their data center.
NVIDIA H100 NVL cards use three NVIDIA® NVLink® bridges. They are the same as theÂ
one used with NVIDIA H100 PCIe cards. This allows two NVIDIA H100 PCIe cards to beÂ
connected to deliver 600 GB/s bidirectional bandwidth or 10x the bandwidth of PCIeÂ
Gen4, to maximize application performance for large workloads









