Tag: SambaNova
-
The Register: Nvidia won the AI training race, but inference is still anyone’s game
Source URL: https://www.theregister.com/2025/03/12/training_inference_shift/ Source: The Register Title: Nvidia won the AI training race, but inference is still anyone’s game Feedly Summary: When it’s all abstracted by an API endpoint, do you even care what’s behind the curtain? Comment With the exception of custom cloud silicon, like Google’s TPUs or Amazon’s Trainium ASICs, the vast majority…
-
The Register: Enterprises in for a shock when they realize power and cooling demands of AI
Source URL: https://www.theregister.com/2025/01/15/ai_power_cooling_demands/ Source: The Register Title: Enterprises in for a shock when they realize power and cooling demands of AI Feedly Summary: Energy consumption set to become a key performance indicator by 2027 Most businesses rushing to adopt AI are unprepared for the energy demands it’ll place on their infrastructure, and few have a…
-
The Register: SambaNova makes Llama gallop in inference cloud debut
Source URL: https://www.theregister.com/2024/09/10/sambanovas_inference_cloud/ Source: The Register Title: SambaNova makes Llama gallop in inference cloud debut Feedly Summary: AI infra startup serves up Llama 3.1 405B at 100+ tokens per second Not to be outdone by rival AI systems upstarts, SambaNova has launched inference cloud of its own that it says is ready to serve up…