Tag: networking choice
-
Hacker News: MI300X vs. H100 vs. H200 Benchmark Part 1: Training – CUDA Moat Still Alive
Source URL: https://semianalysis.com/2024/12/22/mi300x-vs-h100-vs-h200-benchmark-part-1-training/ Source: Hacker News Title: MI300X vs. H100 vs. H200 Benchmark Part 1: Training – CUDA Moat Still Alive Feedly Summary: Comments AI Summary and Description: Yes **Summary:** The text offers a comprehensive analysis of AMD’s MI300X compared to Nvidia’s H100 and H200 in the realm of GPU performance, emphasizing the gaps in…
-
The Register: xAI picked Ethernet over InfiniBand for its H100 Colossus training cluster
Source URL: https://www.theregister.com/2024/10/29/xai_colossus_networking/ Source: The Register Title: xAI picked Ethernet over InfiniBand for its H100 Colossus training cluster Feedly Summary: Work already underway to expand system to 200,000 Nvidia Hopper chips Unlike most AI training clusters, xAI’s Colossus with its 100,000 Nvidia Hopper GPUs doesn’t use InfiniBand. Instead, the massive system, which Nvidia bills as…