Experimental News Clipping Site

Tag: Hugging Face

  • Simon Willison’s Weblog: llama.cpp guide: running gpt-oss with llama.cpp

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Aug/19/gpt-oss-with-llama-cpp/ Source: Simon Willison’s Weblog Title: llama.cpp guide: running gpt-oss with llama.cpp Feedly Summary: llama.cpp guide: running gpt-oss with llama.cpp Really useful official guide to running the OpenAI gpt-oss models using llama-server from llama.cpp – which provides an OpenAI-compatible localhost API and a neat web interface for interacting with the models. TLDR version…

  • Cloud Blog: An efficient path to production AI: Kakao’s journey with JAX and Cloud TPUs

    —

    by

    Kurt Seifried
    in

    Source URL: https://cloud.google.com/blog/products/infrastructure-modernization/kakaos-journey-with-jax-and-cloud-tpus/ Source: Cloud Blog Title: An efficient path to production AI: Kakao’s journey with JAX and Cloud TPUs Feedly Summary: When your messaging platform serves 49 million people – 93% of South Korea’s population – every technical decision carries enormous weight. The engineering team at Kakao faced exactly this challenge when their existing…

  • Simon Willison’s Weblog: Introducing Gemma 3 270M: The compact model for hyper-efficient AI

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Aug/14/gemma-3-270m/#atom-everything Source: Simon Willison’s Weblog Title: Introducing Gemma 3 270M: The compact model for hyper-efficient AI Feedly Summary: Introducing Gemma 3 270M: The compact model for hyper-efficient AI New from Google: Gemma 3 270M, a compact, 270-million parameter model designed from the ground up for task-specific fine-tuning with strong instruction-following and text structuring…

  • Cloud Blog: Run OpenAI’s new gpt-oss model at scale with Google Kubernetes Engine

    —

    by

    Kurt Seifried
    in

    Source URL: https://cloud.google.com/blog/products/containers-kubernetes/run-openais-new-gpt-oss-model-at-scale-with-gke/ Source: Cloud Blog Title: Run OpenAI’s new gpt-oss model at scale with Google Kubernetes Engine Feedly Summary: It’s exciting to see OpenAI contribute to the open ecosystem with the release of their new open weights model, gpt-oss. In keeping with our commitment to provide the best platform for open AI innovation, we’re…

  • Docker: Tooling ≠ Glue: Why changing AI workflows still feels like duct tape

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.docker.com/blog/why-changing-ai-workflows-still-feels-like-duct-tape/ Source: Docker Title: Tooling ≠ Glue: Why changing AI workflows still feels like duct tape Feedly Summary: There’s a weird contradiction in modern AI development. We have better tools than ever. We’re building smarter systems with cleaner abstractions. And yet, every time you try to swap out a component in your stack,…

  • Simon Willison’s Weblog: Qwen3-4B Instruct and Thinking

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Aug/6/qwen3-4b-instruct-and-thinking/ Source: Simon Willison’s Weblog Title: Qwen3-4B Instruct and Thinking Feedly Summary: Qwen3-4B Instruct and Thinking Yet another interesting model from Qwen—these are tiny compared to their other recent releases (just 4B parameters, 7.5GB on Hugging Face and even smaller when quantized) but with a 262,144 context length, which Qwen suggest is essential…