Experimental News Clipping Site

Tag: quantized

  • Slashdot: DeepSeek-V3 Now Runs At 20 Tokens Per Second On Mac Studio

    —

    by

    Kurt Seifried
    in

    Source URL: https://apple.slashdot.org/story/25/03/25/2054214/deepseek-v3-now-runs-at-20-tokens-per-second-on-mac-studio?utm_source=rss1.0mainlinkanon&utm_medium=feed Source: Slashdot Title: DeepSeek-V3 Now Runs At 20 Tokens Per Second On Mac Studio Feedly Summary: AI Summary and Description: Yes Summary: The text discusses the launch of DeepSeek’s new large language model, DeepSeek-V3-0324, highlighting its unique deployment strategy and implications for the AI industry. Its compatibility with consumer-grade hardware and open-source…

  • Simon Willison’s Weblog: Mistral Small 3.1

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Mar/17/mistral-small-31/#atom-everything Source: Simon Willison’s Weblog Title: Mistral Small 3.1 Feedly Summary: Mistral Small 3.1 Mistral Small 3 came out in January and was a notable, genuinely excellent local model that used an Apache 2.0 license. Mistral Small 3.1 offers a significant improvement: it’s multi-modal (images) and has an increased 128,000 token context length,…

  • The Register: DeepSeek-R1-beating perf in a 32B package? El Reg digs its claws into Alibaba’s QwQ

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.theregister.com/2025/03/16/qwq_hands_on_review/ Source: The Register Title: DeepSeek-R1-beating perf in a 32B package? El Reg digs its claws into Alibaba’s QwQ Feedly Summary: How to tame its hypersensitive hyperparameters and get it running on your PC Hands on How much can reinforcement learning – and a bit of extra verification – improve large language models,…

  • Scott Logic: There is more than one way to do GenAI

    —

    by

    Kurt Seifried
    in

    Source URL: https://blog.scottlogic.com/2025/02/20/there-is-more-than-one-way-to-do-genai.html Source: Scott Logic Title: There is more than one way to do GenAI Feedly Summary: AI doesn’t have to be brute forced requiring massive data centres. Europe isn’t necessarily behind in AI arms race. In fact, the UK and Europe’s constraints and focus on more than just economic return and speculation might…

  • Hacker News: Using pip to install a Large Language Model that’s under 100MB

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Feb/7/pip-install-llm-smollm2/ Source: Hacker News Title: Using pip to install a Large Language Model that’s under 100MB Feedly Summary: Comments AI Summary and Description: Yes **Summary:** The text discusses the release of a new Python package, llm-smollm2, which allows users to install a quantized Large Language Model (LLM) under 100MB through pip. It provides…