Tag: floating point numbers
-
Simon Willison’s Weblog: Qwen3-8B
Source URL: https://simonwillison.net/2025/May/2/qwen3-8b/#atom-everything Source: Simon Willison’s Weblog Title: Qwen3-8B Feedly Summary: Having tried a few of the Qwen 3 models now my favorite is a bit of a surprise to me: I’m really enjoying Qwen3-8B. I’ve been running prompts through the MLX 4bit quantized version, mlx-community/Qwen3-8B-4bit. I’m using llm-mlx like this: llm install llm-mlx llm…
-
Simon Willison’s Weblog: State-of-the-art text embedding via the Gemini API
Source URL: https://simonwillison.net/2025/Mar/7/gemini-embeddings/#atom-everything Source: Simon Willison’s Weblog Title: State-of-the-art text embedding via the Gemini API Feedly Summary: State-of-the-art text embedding via the Gemini API Gemini just released their new text embedding model, with the snappy name gemini-embedding-exp-03-07. It supports 8,000 input tokens – up from 3,000 – and outputs vectors that are a lot larger…
-
Simon Willison’s Weblog: Nomic Embed Text V2: An Open Source, Multilingual, Mixture-of-Experts Embedding Model
Source URL: https://simonwillison.net/2025/Feb/12/nomic-embed-text-v2/#atom-everything Source: Simon Willison’s Weblog Title: Nomic Embed Text V2: An Open Source, Multilingual, Mixture-of-Experts Embedding Model Feedly Summary: Nomic Embed Text V2: An Open Source, Multilingual, Mixture-of-Experts Embedding Model Nomic continue to release the most interesting and powerful embedding models. Their latest is Embed Text V2, an Apache 2.0 licensed multi-lingual 1.9GB…
-
Simon Willison’s Weblog: The impact of competition and DeepSeek on Nvidia
Source URL: https://simonwillison.net/2025/Jan/27/deepseek-nvidia/ Source: Simon Willison’s Weblog Title: The impact of competition and DeepSeek on Nvidia Feedly Summary: The impact of competition and DeepSeek on Nvidia Long, excellent piece by Jeffrey Emanuel capturing the current state of the AI/LLM industry. The original title is “The Short Case for Nvidia Stock" – I’m using the Hacker…
-
Simon Willison’s Weblog: Binary vector embeddings are so cool
Source URL: https://simonwillison.net/2024/Nov/11/binary-vector-embeddings/#atom-everything Source: Simon Willison’s Weblog Title: Binary vector embeddings are so cool Feedly Summary: Binary vector embeddings are so cool Evan Schwartz: Vector embeddings by themselves are pretty neat. Binary quantized vector embeddings are extra impressive. In short, they can retain 95+% retrieval accuracy with 32x compression and ~25x retrieval speedup. It’s so…