Media Summary: Want to scale beyond the limits of a single GPU? Learn how to use CUDA-aware MPI, NVSHMEM, and Zhiyi Hu, Siyuan Shen, Tommaso Bonato (ETH Zurich), Sylvain Jeaugey (NVIDIA), Cedell Alexander, Eric Spada (Broadcom), ... In this AI Research Roundup episode, Alex discusses the paper: 'Collective Communication for 100k+ GPUs(2510.20171v1)' This ...
Multigpu Nccl From The Authors - Detailed Analysis & Overview
Want to scale beyond the limits of a single GPU? Learn how to use CUDA-aware MPI, NVSHMEM, and Zhiyi Hu, Siyuan Shen, Tommaso Bonato (ETH Zurich), Sylvain Jeaugey (NVIDIA), Cedell Alexander, Eric Spada (Broadcom), ... In this AI Research Roundup episode, Alex discusses the paper: 'Collective Communication for 100k+ GPUs(2510.20171v1)' This ... Welcome to this deep dive into GPU-GPU communication for high-performance computing and machine learning with me, Dr. This video was recorded at Lambda Days 2022 - Using smoke and mirrors to ... NCCL: High-Speed Inter-GPU Communication for Large-Scale Training - Sylvain Jeaugey, NVIDIA
Presenter(s): James Hongyi Zeng, Senior Engineering Manager, Meta As Meta's AI infrastructure scales to massive- ... Scaling beyond a single GPU doesn't have to be hard. In this NVIDIA GTC 2025 session, explore how distributed Materials and Molecular Modelling Hub GPU Training Day:
