Tag: xpu
-
Cloud Blog: Supercharge ML performance on xPUs with the new XProf profiler and Cloud Diagnostics XProf library
Source URL: https://cloud.google.com/blog/topics/developers-practitioners/supercharge-ml-performance-on-xpus-with-the-new-xprof-profiler-and-cloud-diagnostics-xprof-library/ Source: Cloud Blog Title: Supercharge ML performance on xPUs with the new XProf profiler and Cloud Diagnostics XProf library Feedly Summary: Are you spending more time debugging ML model performance than you are building? You’re not alone. In today’s fast-paced AI landscape, optimizing models is a complex challenge, from navigating new model…
-
Cloud Blog: vLLM Performance Tuning: The Ultimate Guide to xPU Inference Configuration
Source URL: https://cloud.google.com/blog/topics/developers-practitioners/vllm-performance-tuning-the-ultimate-guide-to-xpu-inference-configuration/ Source: Cloud Blog Title: vLLM Performance Tuning: The Ultimate Guide to xPU Inference Configuration Feedly Summary: Additional contributors include Hossein Sarshar, Ashish Narasimham, and Chenyang Li. Large Language Models (LLMs) are revolutionizing how we interact with technology, but serving these powerful models efficiently can be a challenge. vLLM has rapidly become…