NVIDIA HGX: Open Platform Powering Large-Scale AI and HPC
The NVIDIA HGX platform has established itself as the de facto standard for training and deploying large-scale artificial intelligence (AI) models. With a combination of Hopper (H100/H200) and, starting in 2024, Blackwell (B200/B300) GPUs, a 1.8 TB/s NVLink 5 interconnect, 800 Gb/s InfiniBand and Ethernet networks, BlueField-3 DPUs, and an open, community-defined OCP format, HGX delivers the performance, scalability, and efficiency required by generative models with trillions of parameters. The Computational Challenge of Modern AI Language and vision models now…