Tag: performance

Source URL: https://simonwillison.net/2025/Aug/11/llm-027/ Source: Simon Willison’s Weblog Title: LLM 0.27, the annotated release notes: GPT-5 and improved tool calling Feedly Summary: I shipped LLM 0.27 today, adding support for the new GPT-5 family of models from OpenAI plus a flurry of improvements to the tool calling features introduced in LLM 0.26. Here are the annotated…

Cloud Blog: Run OpenAI’s new gpt-oss model at scale with Google Kubernetes Engine

—

by

Source URL: https://cloud.google.com/blog/products/containers-kubernetes/run-openais-new-gpt-oss-model-at-scale-with-gke/ Source: Cloud Blog Title: Run OpenAI’s new gpt-oss model at scale with Google Kubernetes Engine Feedly Summary: It’s exciting to see OpenAI contribute to the open ecosystem with the release of their new open weights model, gpt-oss. In keeping with our commitment to provide the best platform for open AI innovation, we’re…

Cloud Blog: Taming the stragglers: Maximize AI training performance with automated straggler detection

—

by

Source URL: https://cloud.google.com/blog/products/compute/stragglers-in-ai-a-guide-to-automated-straggler-detection/ Source: Cloud Blog Title: Taming the stragglers: Maximize AI training performance with automated straggler detection Feedly Summary: Stragglers are an industry-wide issue for developers working with large-scale machine learning workloads. The larger and more powerful these systems become, the more their performance is hostage to the subtle misbehavior of a single component.…

Cloud Blog: How Yahoo Calendar broke free from hardware queues and DBA bottlenecks

—

by

Source URL: https://cloud.google.com/blog/products/infrastructure-modernization/how-yahoo-calendar-broke-free-from-hardware-queues-and-dba-bottlenecks/ Source: Cloud Blog Title: How Yahoo Calendar broke free from hardware queues and DBA bottlenecks Feedly Summary: Editor’s note: Yahoo Mail is in the midst of one of its largest infrastructure transformations to date: a multi-year effort to modernize hundreds of petabytes of services by moving to Google Cloud.The Yahoo Mail migration…

Simon Willison’s Weblog: Qwen3-4B-Thinking: "This is art – pelicans don’t ride bikes!"

—

by

Source URL: https://simonwillison.net/2025/Aug/10/qwen3-4b/#atom-everything Source: Simon Willison’s Weblog Title: Qwen3-4B-Thinking: "This is art – pelicans don’t ride bikes!" Feedly Summary: I’ve fallen a few days behind keeping up with Qwen. They released two new 4B models last week: Qwen3-4B-Instruct-2507 and its thinking equivalent Qwen3-4B-Thinking-2507. These are relatively tiny models that punch way above their weight. I’ve…

The Register: How OpenAI used a new data type to cut inference costs by 75%

Aug 10, 2025

—

by

Source URL: https://www.theregister.com/2025/08/10/openai_mxfp4/ Source: The Register Title: How OpenAI used a new data type to cut inference costs by 75% Feedly Summary: Decision to use MXFP4 makes models smaller, faster, and more importantly, cheaper for everyone involved Analysis Whether or not OpenAI’s new open weights models are any good is still up for debate, but…

Simon Willison’s Weblog: Quoting Ethan Mollick

Aug 9, 2025

—

by

Source URL: https://simonwillison.net/2025/Aug/9/ethan-mollick/#atom-everything Source: Simon Willison’s Weblog Title: Quoting Ethan Mollick Feedly Summary: The issue with GPT-5 in a nutshell is that unless you pay for model switching & know to use GPT-5 Thinking or Pro, when you ask “GPT-5” you sometimes get the best available AI & sometimes get one of the worst AIs…

Docker: Remocal and Minimum Viable Models: Why Right-Sized Models Beat API Overkill

Aug 9, 2025

—

by

Source URL: https://www.docker.com/blog/remocal-minimum-viable-models-ai/ Source: Docker Title: Remocal and Minimum Viable Models: Why Right-Sized Models Beat API Overkill Feedly Summary: A practical approach to escaping the expensive, slow world of API-dependent AI The $20K Monthly Reality Check You built a simple sentiment analyzer for customer reviews. It works great. Except it costs $847/month in API calls…

The Cloudflare Blog: Redesigning Workers KV for increased availability and faster performance

Aug 8, 2025

—

by