Tag: rank branch
-
Hacker News: SVDQuant+NVFP4: 4× Smaller, 3× Faster FLUX with 16-bit Quality on Blackwell GPUs
Source URL: https://hanlab.mit.edu/blog/svdquant-nvfp4 Source: Hacker News Title: SVDQuant+NVFP4: 4× Smaller, 3× Faster FLUX with 16-bit Quality on Blackwell GPUs Feedly Summary: Comments AI Summary and Description: Yes **Summary:** The text discusses the release of SVDQuant, a new low-precision quantization paradigm that supports NVIDIA’s NVFP4 architecture on Blackwell GPUs. It highlights significant improvements in model accuracy,…
-
Hacker News: SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 4090 GPU with 3x Speedup
Source URL: https://hanlab.mit.edu/blog/svdquant Source: Hacker News Title: SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 4090 GPU with 3x Speedup Feedly Summary: Comments AI Summary and Description: Yes **Summary:** The provided text discusses the innovative SVDQuant paradigm for post-training quantization of diffusion models, which enhances computational efficiency by quantizing both weights and activations to…