How-ToAI ModelsOctober 25, 2026

Guide tests Underdog Saluki 27B, a 2-bit Qwen3.8-27B build

Read original source →marktechpost.com

Saluki is a 7.9 GB quantization of Qwen3.8-27B that its makers say keeps tool calling intact at ~2 bits per weight and beats the full 54 GB model on their own 120-task benchmark. The tutorial compares it against ISTA-DASLab's GSQ-RCO quantization in stock llama.cpp, scoring both on seeded BFCL tasks.

1 source

More stories today

Open the live feed