Tech & AI News
Hacker News

Unsloth Dynamic 3.0 GGUFs

Unsloth Dynamic v3.0 quantizes the Qwen 3.8-27B model, delivering over 10% higher top-1 accuracy than rival providers while maintaining the same file size. It ships GGUFs for llama.cpp and Unsloth Desktop, uses an improved imatrix calibration set, and adds 1-bit variants such as UD-IQ1_S (6.2 GB) with ~72% top-1 accuracy. Benchmarks on a 300-example Divergence-300 @32 dataset show UD-Q2_K_XL (9.83 GB) is about 8% more accurate than the next best quant, though 1-bit models drop sharply on agentic tasks.