Tag: small models

  • Tomasz Tunguz: Small Action Models Are the Future of AI Agents

    Source URL: https://www.tomtunguz.com/ai-skills-inversion/ Source: Tomasz Tunguz Title: Small Action Models Are the Future of AI Agents Feedly Summary: 2025 is the year of agents, and the key capability of agents is calling tools. When using Claude Code, I can tell the AI to sift through a newsletter, find all the links to startups, verify they…

  • Simon Willison’s Weblog: Devstral

    Source URL: https://simonwillison.net/2025/May/21/devstral/#atom-everything Source: Simon Willison’s Weblog Title: Devstral Feedly Summary: Devstral New Apache 2.0 licensed LLM release from Mistral, this time specifically trained for code. Devstral achieves a score of 46.8% on SWE-Bench Verified, outperforming prior open-source SoTA models by more than 6% points. When evaluated under the same test scaffold (OpenHands, provided by…

  • Simon Willison’s Weblog: Mistral Small 3

    Source URL: https://simonwillison.net/2025/Jan/30/mistral-small-3/#atom-everything Source: Simon Willison’s Weblog Title: Mistral Small 3 Feedly Summary: Mistral Small 3 First model release of 2025 for French AI lab Mistral, who describe Mistral Small 3 as “a latency-optimized 24B-parameter model released under the Apache 2.0 license." More notably, they claim the following: Mistral Small 3 is competitive with larger…

  • Hacker News: TinyStories: How Small Can Language Models Be and Still Speak Coherent English?

    Source URL: https://arxiv.org/abs/2305.07759 Source: Hacker News Title: TinyStories: How Small Can Language Models Be and Still Speak Coherent English? Feedly Summary: Comments AI Summary and Description: Yes Summary: The text discusses a study on the capabilities of small language models in generating coherent text using a new dataset called TinyStories. The findings suggest that even…

  • Simon Willison’s Weblog: llm-gguf 0.2, now with embeddings

    Source URL: https://simonwillison.net/2024/Nov/21/llm-gguf-embeddings/#atom-everything Source: Simon Willison’s Weblog Title: llm-gguf 0.2, now with embeddings Feedly Summary: llm-gguf 0.2, now with embeddings This new release of my llm-gguf plugin – which adds support for locally hosted GGUF LLMs – adds a new feature: it now supports embedding models distributed as GGUFs as well. This means you can…

  • Simon Willison’s Weblog: NuExtract 1.5

    Source URL: https://simonwillison.net/2024/Nov/16/nuextract-15/#atom-everything Source: Simon Willison’s Weblog Title: NuExtract 1.5 Feedly Summary: NuExtract 1.5 Structured extraction – where an LLM helps turn unstructured text (or image content) into structured data – remains one of the most directly useful applications of LLMs. NuExtract is a family of small models directly trained for this purpose, and released…