Experimental News Clipping Site

Tag: Docker Model Runner

  • Docker: LoRA Explained: Faster, More Efficient Fine-Tuning with Docker

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.docker.com/blog/lora-explained/ Source: Docker Title: LoRA Explained: Faster, More Efficient Fine-Tuning with Docker Feedly Summary: Fine-tuning a language model doesn’t have to be daunting. In our previous post on fine-tuning models with Docker Offload and Unsloth, we walked through how to train small, local models efficiently using Docker’s familiar workflows. This time, we’re narrowing…

  • Docker: Unlocking Local AI on Any GPU: Docker Model Runner Now with Vulkan Support

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.docker.com/blog/docker-model-runner-vulkan-gpu-support/ Source: Docker Title: Unlocking Local AI on Any GPU: Docker Model Runner Now with Vulkan Support Feedly Summary: Running large language models (LLMs) on your local machine is one of the most exciting frontiers in AI development. At Docker, our goal is to make this process as simple and accessible as possible.…

  • Docker: IBM Granite 4.0 Models Now Available on Docker Hub

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.docker.com/blog/ibm-granite-4-0-models-now-available-on-docker-hub/ Source: Docker Title: IBM Granite 4.0 Models Now Available on Docker Hub Feedly Summary: Developers can now discover and run IBM’s latest open-source Granite 4.0 language models from the Docker Hub model catalog, and start building in minutes with Docker Model Runner. Granite 4.0 pairs strong, enterprise-ready performance with a lightweight footprint,…

  • Docker: Llama.cpp Gets an Upgrade: Resumable Model Downloads

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.docker.com/blog/llama-cpp-resumable-gguf-downloads/ Source: Docker Title: Llama.cpp Gets an Upgrade: Resumable Model Downloads Feedly Summary: We’ve all been there: you’re 90% of the way through downloading a massive, multi-gigabyte GGUF model file for llama.cpp when your internet connection hiccups. The download fails, and the progress bar resets to zero. It’s a frustrating experience that wastes…

  • Docker: Fine-Tuning Local Models with Docker Offload and Unsloth

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.docker.com/blog/fine-tuning-models-with-offload-and-unsloth/ Source: Docker Title: Fine-Tuning Local Models with Docker Offload and Unsloth Feedly Summary: I’ve been experimenting with local models for a while now, and the progress in making them accessible has been exciting. Initial experiences are often fantastic, many models, like Gemma 3 270M, are lightweight enough to run on common hardware.…

  • Docker: Run, Test, and Evaluate Models and MCP Locally with Docker + Promptfoo

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.docker.com/blog/evaluate-models-and-mcp-with-promptfoo-docker/ Source: Docker Title: Run, Test, and Evaluate Models and MCP Locally with Docker + Promptfoo Feedly Summary: Promptfoo is an open-source CLI and library for evaluating LLM apps. Docker Model Runner makes it easy to manage, run, and deploy AI models using Docker. The Docker MCP Toolkit is a local gateway that…

  • Docker: Docker Model Runner General Availability

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.docker.com/blog/announcing-docker-model-runner-ga/ Source: Docker Title: Docker Model Runner General Availability Feedly Summary: We’re excited to share that Docker Model Runner is now generally available (GA)! In April 2025, Docker introduced the first Beta release of Docker Model Runner, making it easy to manage, run, and distribute local AI models (specifically LLMs). Though only a…

  • Docker: Prototyping an AI Tutor with Docker Model Runner

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.docker.com/blog/how-to-build-an-ai-tutor-with-model-runner/ Source: Docker Title: Prototyping an AI Tutor with Docker Model Runner Feedly Summary: Every developer remembers their first docker run hello-world. The mix of excitement and wonder as that simple command pulls an image, creates a container, and displays a friendly message. But what if AI could make that experience even better?…

  • Docker: Docker Desktop 4.44: Smarter AI Modeling, Platform Stability, and Streamlined Kubernetes Workflows

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.docker.com/blog/docker-desktop-4-44/ Source: Docker Title: Docker Desktop 4.44: Smarter AI Modeling, Platform Stability, and Streamlined Kubernetes Workflows Feedly Summary: In Docker Desktop 4.44, we’ve focused on delivering enhanced reliability, tighter AI modeling controls, and simplified tool integrations so you can build on your terms. Docker Model Runner Enhancements  Inspectable Model Runner Workflows Now you…

  • Docker: Building AI agents made easy with Goose and Docker

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.docker.com/blog/building-ai-agents-with-goose-and-docker/ Source: Docker Title: Building AI agents made easy with Goose and Docker Feedly Summary: Building AI agents can be a complex task. But it also can be a fairly simple combination of answers to the following questions:  What is the AI backend that powers my intelligent fuzzy computation? What tools do you…