Tag: quantized
-
Cloud Blog: How much energy does Google’s AI use? We did the math
Source URL: https://cloud.google.com/blog/products/infrastructure/measuring-the-environmental-impact-of-ai-inference/ Source: Cloud Blog Title: How much energy does Google’s AI use? We did the math Feedly Summary: AI is unlocking scientific breakthroughs, improving healthcare and education, and could add trillions to the global economy. Understanding AI’s footprint is crucial, yet thorough data on the energy and environmental impact of AI inference —…
-
Simon Willison’s Weblog: Qwen3-4B Instruct and Thinking
Source URL: https://simonwillison.net/2025/Aug/6/qwen3-4b-instruct-and-thinking/ Source: Simon Willison’s Weblog Title: Qwen3-4B Instruct and Thinking Feedly Summary: Qwen3-4B Instruct and Thinking Yet another interesting model from Qwen—these are tiny compared to their other recent releases (just 4B parameters, 7.5GB on Hugging Face and even smaller when quantized) but with a 262,144 context length, which Qwen suggest is essential…