Tag: GPUs
-
The Register: Supermicro crams 18 GPUs into a 3U AI server that’s a little slow by design
Source URL: https://www.theregister.com/2024/10/09/supermicro_sys_322gb_nr_18_gpu_server/ Source: The Register Title: Supermicro crams 18 GPUs into a 3U AI server that’s a little slow by design Feedly Summary: Can handle edge inferencing or run a 64 display command center GPU-enhanced servers can typically pack up to eight of the accelerators, but Supermicro has built a box that manages to…
-
The Register: Copper’s reach is shrinking so Broadcom is strapping optics directly to GPUs
Source URL: https://www.theregister.com/2024/08/28/broadcom_optics_gpus/ Source: The Register Title: Copper’s reach is shrinking so Broadcom is strapping optics directly to GPUs Feedly Summary: What good is going fast if you can’t get past the next rack? In modern AI systems, using PCIe to stitch together accelerators is already too slow. Nvidia and AMD use specialized interconnects like…