Microsoft future trends will get betterMicrosoft Announces Official Launch of Virtual Machine Azure ND H100 V5 VM Series to Help Organizations Handle Generative AI Tasks More Efficiently
ONE. The most powerful and highly scalable AI VM series to date
ND H100 v5 VM, Azure's most powerful and highly scalable AI VM series to date
This VM supports on-demand configurations of up to 8 to thousands of NVIDIA H100 GPUs interconnected via Quantum-2 nfiniBand network, enabling significantly higher performance of AI models. Compared to the previous generation of ND A100 v4 VMs, this release includes the following innovations.
8 NVIDIA H100 Tensor Core GPUs connected via the next generation NV Switch and NV Link 4.0. In a non-blocking fat tree network, each GPU carries 400GD/s NVDIA Quantum-2 CX7 nfiniBand and 3.2Tb /s performance per VM. The eight ground GPUS in each VM are interconnected via 3.8Tb/s pairs of split bandwidth NV Switch and NV Link 4.0 interconnections with fourth-generation Intel Xeon Scalable processors. PCIE Gen 5 host-to-GPU interconnections are available with 64Gb/s 16-channel 4800 MHZ DDR5 memory per GPU bandwidth.
The new VMs use NVIDIA's NVIDIA Tensor Core H100 GPUs and NVIDIA Quantum-2 nfiniBand networking, Microsoft added, adding that the company is working to add hundreds of thousands of new GPUs to its VMs over the next year
