TPUs – Page 2 – Experimental News Clipping Site

Cloud Blog: Scaling high-performance inference cost-effectively

Sep 10, 2025

—

by

Source URL: https://cloud.google.com/blog/products/ai-machine-learning/gke-inference-gateway-and-quickstart-are-ga/ Source: Cloud Blog Title: Scaling high-performance inference cost-effectively Feedly Summary: At Google Cloud Next 2025, we announced new inference capabilities with GKE Inference Gateway, including support for vLLM on TPUs, Ironwood TPUs, and Anywhere Cache. Our inference solution is based on AI Hypercomputer, a system built on our experience running models like…

Slashdot: How Google Is Already Monetizing Its AI Services To Generate Revenue

Sep 9, 2025

—

by

Kurt Seifried

in Uncategorized

Source URL: https://tech.slashdot.org/story/25/09/09/2118248/how-google-is-already-monetizing-its-ai-services-to-generate-revenue?utm_source=rss1.0mainlinkanon&utm_medium=feed Source: Slashdot Title: How Google Is Already Monetizing Its AI Services To Generate Revenue Feedly Summary: AI Summary and Description: Yes Summary: Google Cloud CEO Thomas Kurian discussed the significant revenue streams generated by AI through various monetization strategies such as consumption-based pricing, subscriptions, and upselling. With a growing backlog of orders…

Cloud Blog: Happy birthday, GKE! Let’s celebrate with new features and better pricing

Aug 26, 2025

—

by

Kurt Seifried

in Uncategorized

Source URL: https://cloud.google.com/blog/products/containers-kubernetes/gke-gets-new-pricing-and-capabilities-on-10th-birthday/ Source: Cloud Blog Title: Happy birthday, GKE! Let’s celebrate with new features and better pricing Feedly Summary: “While containers make packaging apps easier, a powerful cluster manager and orchestration system is necessary to bring your workloads to production.” Ten years ago, these words opened the blog post announcing Google Kubernetes Engine (GKE).…

Cloud Blog: vLLM Performance Tuning: The Ultimate Guide to xPU Inference Configuration

Aug 25, 2025

—

by

Kurt Seifried

in Uncategorized

Source URL: https://cloud.google.com/blog/topics/developers-practitioners/vllm-performance-tuning-the-ultimate-guide-to-xpu-inference-configuration/ Source: Cloud Blog Title: vLLM Performance Tuning: The Ultimate Guide to xPU Inference Configuration Feedly Summary: Additional contributors include Hossein Sarshar, Ashish Narasimham, and Chenyang Li. Large Language Models (LLMs) are revolutionizing how we interact with technology, but serving these powerful models efficiently can be a challenge. vLLM has rapidly become…

Cloud Blog: 101+ gen AI use cases with technical blueprints

Aug 21, 2025

—

by

Kurt Seifried

in Uncategorized

Source URL: https://cloud.google.com/blog/products/ai-machine-learning/real-world-gen-ai-use-cases-with-technical-blueprints/ Source: Cloud Blog Title: 101+ gen AI use cases with technical blueprints Feedly Summary: A little over a year ago, we published a list of generative AI use cases that has since grown to include more than 600 examples of how organizations are putting AI to work. Yet for many developers and…

Cloud Blog: How much energy does Google’s AI use? We did the math

Aug 21, 2025

—

by

Kurt Seifried

in Uncategorized

Source URL: https://cloud.google.com/blog/products/infrastructure/measuring-the-environmental-impact-of-ai-inference/ Source: Cloud Blog Title: How much energy does Google’s AI use? We did the math Feedly Summary: AI is unlocking scientific breakthroughs, improving healthcare and education, and could add trillions to the global economy. Understanding AI’s footprint is crucial, yet thorough data on the energy and environmental impact of AI inference —…

Cloud Blog: Rightsizing LLM Serving on vLLM for GPUs and TPUs

Aug 19, 2025

—

by

Kurt Seifried

in Uncategorized

Source URL: https://cloud.google.com/blog/topics/developers-practitioners/rightsizing-llm-serving-on-vllm-for-gpus-and-tpus/ Source: Cloud Blog Title: Rightsizing LLM Serving on vLLM for GPUs and TPUs Feedly Summary: Additional contributors include Hossein Sarshar and Ashish Narasimham. Large Language Models (LLMs) are revolutionizing how we interact with technology, but serving these powerful models efficiently can be a challenge. vLLM has rapidly become the primary choice for…

Cloud Blog: An efficient path to production AI: Kakao’s journey with JAX and Cloud TPUs

Aug 19, 2025

—

by

Kurt Seifried

in Uncategorized

Source URL: https://cloud.google.com/blog/products/infrastructure-modernization/kakaos-journey-with-jax-and-cloud-tpus/ Source: Cloud Blog Title: An efficient path to production AI: Kakao’s journey with JAX and Cloud TPUs Feedly Summary: When your messaging platform serves 49 million people – 93% of South Korea’s population – every technical decision carries enormous weight. The engineering team at Kakao faced exactly this challenge when their existing…

Cloud Blog: Scalable AI starts with storage: Guide to model artifact strategies

Aug 14, 2025

—

by

Kurt Seifried

in Uncategorized

Source URL: https://cloud.google.com/blog/topics/developers-practitioners/scalable-ai-starts-with-storage-guide-to-model-artifact-strategies/ Source: Cloud Blog Title: Scalable AI starts with storage: Guide to model artifact strategies Feedly Summary: Managing large model artifacts is a common bottleneck in MLOps. Baking models into container images leads to slow, monolithic deployments, and downloading them at startup introduces significant delays. This guide explores a better way: decoupling your…

Cloud Blog: Google is a Leader in the 2025 Gartner® Magic Quadrant™ for Container Management

Aug 12, 2025

—

by

Kurt Seifried

in Uncategorized

Source URL: https://cloud.google.com/blog/products/containers-kubernetes/2025-gartner-magic-quadrant-for-container-management-leader/ Source: Cloud Blog Title: Google is a Leader in the 2025 Gartner® Magic Quadrant™ for Container Management Feedly Summary: We’re excited to share that Gartner has recognized Google as a Leader for the third year in a row in the 2025 Gartner® Magic Quadrant™ for Container Management, based on its Completeness of…

Tag: TPUs