Tag: SambaNova
-
The Register: Enterprises in for a shock when they realize power and cooling demands of AI
Source URL: https://www.theregister.com/2025/01/15/ai_power_cooling_demands/ Source: The Register Title: Enterprises in for a shock when they realize power and cooling demands of AI Feedly Summary: Energy consumption set to become a key performance indicator by 2027 Most businesses rushing to adopt AI are unprepared for the energy demands it’ll place on their infrastructure, and few have a…
-
The Register: SambaNova makes Llama gallop in inference cloud debut
Source URL: https://www.theregister.com/2024/09/10/sambanovas_inference_cloud/ Source: The Register Title: SambaNova makes Llama gallop in inference cloud debut Feedly Summary: AI infra startup serves up Llama 3.1 405B at 100+ tokens per second Not to be outdone by rival AI systems upstarts, SambaNova has launched inference cloud of its own that it says is ready to serve up…