Tag: Kubernetes
-
Cloud Blog: Save on GPUs: Smarter autoscaling for your GKE inferencing workloads
Source URL: https://cloud.google.com/blog/products/containers-kubernetes/tuning-the-gke-hpa-to-run-inference-on-gpus/ Source: Cloud Blog Title: Save on GPUs: Smarter autoscaling for your GKE inferencing workloads Feedly Summary: While LLM models deliver immense value for an increasing number of use cases, running LLM inference workloads can be costly. If you’re taking advantage of the latest open models and infrastructure, autoscaling can help you optimize…
-
The Register: Rackspace is back with a seat on the OpenInfra Foundation board
Source URL: https://www.theregister.com/2024/10/23/rackspace_openinfra_board/ Source: The Register Title: Rackspace is back with a seat on the OpenInfra Foundation board Feedly Summary: Absence makes the cloud grow fonder Rackspace, one of the original creators of OpenStack, has been welcomed back into the fold with a seat on the Board of Directors for the OpenInfra Foundation, which oversees…
-
The Cloudflare Blog: Training a million models per day to save customers of all sizes from DDoS attacks
Source URL: https://blog.cloudflare.com/training-a-million-models-per-day-to-save-customers-of-all-sizes-from-ddos Source: The Cloudflare Blog Title: Training a million models per day to save customers of all sizes from DDoS attacks Feedly Summary: In this post we will describe how we use anomaly detection to watch for novel DDoS attacks. We’ll provide an overview of how we build models which flag unusual traffic…
-
The Register: HashiCorp unveils ‘Terraform 2.0’ while tiptoeing around Big Blue elephant in the room
Source URL: https://www.theregister.com/2024/10/18/hashicorp_hashiconf_terraform_updates/ Source: The Register Title: HashiCorp unveils ‘Terraform 2.0’ while tiptoeing around Big Blue elephant in the room Feedly Summary: HashiConf shindig oddly reluctant to mention impending IBM acquisition HashiCorp’s annual HashiConf shindig wrapped up in Boston with a Big Blue elephant in the room and a hissed instruction: “Don’t mention IBM!"… AI…
-
Cloud Blog: How to benchmark application performance from the user’s perspective
Source URL: https://cloud.google.com/blog/products/containers-kubernetes/benchmarking-how-end-users-perceive-an-applications-performance/ Source: Cloud Blog Title: How to benchmark application performance from the user’s perspective Feedly Summary: What kind of performance does your application have, and how do you know? More to the point, what kind of performance do your end users think your application has? In this era of rapid growth and unpredictable…