Tag: quantized vector embeddings
-
Simon Willison’s Weblog: Binary vector embeddings are so cool
Source URL: https://simonwillison.net/2024/Nov/11/binary-vector-embeddings/#atom-everything Source: Simon Willison’s Weblog Title: Binary vector embeddings are so cool Feedly Summary: Binary vector embeddings are so cool Evan Schwartz: Vector embeddings by themselves are pretty neat. Binary quantized vector embeddings are extra impressive. In short, they can retain 95+% retrieval accuracy with 32x compression and ~25x retrieval speedup. It’s so…