Tag: vision-llms
-
Simon Willison’s Weblog: Qwen3-VL: Sharper Vision, Deeper Thought, Broader Action
Source URL: https://simonwillison.net/2025/Sep/23/qwen3-vl/ Source: Simon Willison’s Weblog Title: Qwen3-VL: Sharper Vision, Deeper Thought, Broader Action Feedly Summary: Qwen3-VL: Sharper Vision, Deeper Thought, Broader Action I’ve been looking forward to this. Qwen 2.5 VL is one of the best available open weight vision LLMs, so I had high hopes for Qwen 3’s vision models. Firstly, we…
-
Simon Willison’s Weblog: Magistral 1.2
Source URL: https://simonwillison.net/2025/Sep/19/magistral/ Source: Simon Willison’s Weblog Title: Magistral 1.2 Feedly Summary: Mistral quietly released two new models yesterday: Magistral Small 1.2 (Apache 2.0, 96.1 GB on Hugging Face) and Magistral Medium 1.2 (not open weights same as Mistral’s other “medium" models.) Despite being described as "minor updates" to the Magistral 1.1 models these have…
-
Simon Willison’s Weblog: Quoting Jason Liu
Source URL: https://simonwillison.net/2025/Sep/6/jason-liu/#atom-everything Source: Simon Willison’s Weblog Title: Quoting Jason Liu Feedly Summary: I am once again shocked at how much better image retrieval performance you can get if you embed highly opinionated summaries of an image, a summary that came out of a visual language model, than using CLIP embeddings themselves. If you tell…
-
Simon Willison’s Weblog: Qwen-Image: Crafting with Native Text Rendering
Source URL: https://simonwillison.net/2025/Aug/4/qwen-image/#atom-everything Source: Simon Willison’s Weblog Title: Qwen-Image: Crafting with Native Text Rendering Feedly Summary: Qwen-Image: Crafting with Native Text Rendering Not content with releasing six excellent open weights LLMs in July, Qwen are kicking off August with their first ever image generation model. Qwen-Image is a 20 billion parameter MMDiT (Multimodal Diffusion Transformer,…
-
Simon Willison’s Weblog: TimeScope: How Long Can Your Video Large Multimodal Model Go?
Source URL: https://simonwillison.net/2025/Jul/23/timescope/#atom-everything Source: Simon Willison’s Weblog Title: TimeScope: How Long Can Your Video Large Multimodal Model Go? Feedly Summary: TimeScope: How Long Can Your Video Large Multimodal Model Go? New open source benchmark for evaluating vision LLMs on how well they handle long videos: TimeScope probes the limits of long-video capabilities by inserting several…
-
Simon Willison’s Weblog: Grok 4
Source URL: https://simonwillison.net/2025/Jul/10/grok-4/#atom-everything Source: Simon Willison’s Weblog Title: Grok 4 Feedly Summary: Grok 4 Released last night, Grok 4 is now available via both API and a paid subscription for end-users. Key characteristics: image and text input, text output. 256,000 context length (twice that of Grok 3). It’s a reasoning model where you can’t see…
-
Simon Willison’s Weblog: Introducing Gemma 3n: The developer guide
Source URL: https://simonwillison.net/2025/Jun/26/gemma-3n/ Source: Simon Willison’s Weblog Title: Introducing Gemma 3n: The developer guide Feedly Summary: Introducing Gemma 3n: The developer guide Extremely consequential new open weights model release from Google today: Multimodal by design: Gemma 3n natively supports image, audio, video, and text inputs and text outputs. Optimized for on-device: Engineered with a focus…
-
Simon Willison’s Weblog: How OpenElections Uses LLMs
Source URL: https://simonwillison.net/2025/Jun/19/how-openelections-uses-llms/#atom-everything Source: Simon Willison’s Weblog Title: How OpenElections Uses LLMs Feedly Summary: How OpenElections Uses LLMs The OpenElections project collects detailed election data for the USA, all the way down to the precinct level. This is a surprisingly hard problem: while county and state-level results are widely available, precinct-level results are published in…
-
Simon Willison’s Weblog: qwen2.5vl in Ollama
Source URL: https://simonwillison.net/2025/May/18/qwen25vl-in-ollama/#atom-everything Source: Simon Willison’s Weblog Title: qwen2.5vl in Ollama Feedly Summary: qwen2.5vl in Ollama Ollama announced a complete overhaul of their vision support the other day. Here’s the first new model they’ve shipped since then – a packaged version of Qwen 2.5 VL which was first released on January 26th 2025. Here are…
-
Simon Willison’s Weblog: Building software on top of Large Language Models
Source URL: https://simonwillison.net/2025/May/15/building-on-llms/#atom-everything Source: Simon Willison’s Weblog Title: Building software on top of Large Language Models Feedly Summary: I presented a three hour workshop at PyCon US yesterday titled Building software on top of Large Language Models. The goal of the workshop was to give participants everything they needed to get started writing code that…